Lobster_data

Data Integration with

Lobster_data
Data Integration – Data Conversion –
Data Communication with Lobster_data

It is necessary to make use of electronic data integration (EDI) in

order to run business processes smoothly and to link service providers,
Contents
partners and customers to in-house IT. This is done by software
solutions that integrate internal and external electronic data into the Lobster_data – The central Data Hub Page 4
business processes. They convert existing data into any format and
enable data exchange between different systems. The Advantages of Lobster_data Page 5

Lobster_data
Data Integration with Lobster_data Page 6
Lobster´s Lobster_data is such a tool. However, unlike other software,
Lobster_data provides one single solution for what is normally only Lobster_data: 7 steps to Data Integration Page 7
possible by combining several different software products. SAP Integration using Lobster_data Page 10
Serving as a central data hub, the software enables connectivity,
remote transfer and even data communication between ERP and CMS Useful optional modules:
systems, data bases, web platforms, customers and suppliers – Content Inspection, Fax Service, DataFlow Page 11
without any need for programming skills and fully documentation of all Data Security with Lobster_data Page 12
operations automated.
Lobster_data makes all the Difference Page 14
The following pages show how surprisingly simple data
integration, data conversion and data communication can be
with Lobster_data!

© Lobster GmbH 2015 | 3

 The Advantages of Lobster_data

Technical information
• Support of all common protocols for data transfer (FTP(S), OFTP, OFTP2, SMTP,
Lobster_data – HTTP(S), SMS, SAP-ALE, IBM-Data-Queue, databases, AS2, X.400, WebDAV,
SCP, SSH, ... as well as web services)
the central Data Hub
• Processing of all common data formats (XML, EDIFACT, SAP IDoc, CSV,
FixRecord, VDA, binary Excel, ANSI X.12, TRADECOM, BMECat, PRICAT)

Nowadays, most business communication happens Thus Lobster_data offers: • More than 4,000 main templates for interfacing to ERP systems, as well
electronically. No matter whether internal departments as all major industry standards (EDIFACT, SAP IDoc, VDA, Fortras, ANSI X.12, etc.)
are exchanging data, if ERP and CRM systems need • Universal data conversion
connecting to each other, or if you need to integrate • Clear data mapping using tree structures • Cluster capacity and load balancing allows for fast processing
data formats and structures of external service
providers, business partners or customers with your • Data manipulation without programming
own infrastructure: speed, automation, flexibility and, • Data transfer via direct or remote connection Handling
above all, security are of the essence.
• Detailed monitoring and integrated data backup • Direct access to subsystems (e.g. databases, SAP systems via ALE or
IBM i-Series via DataQueue and direct program call)

• Clearly structured graphical user interface (drag & drop) with ergonomic operability

• Process automation – e.g. integration of partner systems

• Reducing IT administration – one system for all integration tasks

• AS2 and OFTP2 certified – integration of existing standards

Lobster_data • Accelerated order processing

• Information retrieval from web platforms via WebServices

INTERNAL SYSTEMS DATA HUB EXTERNAL
• Transaction-based information flow

WebService
Transparency
CRM HTTP(S)
Customers • Automated generation of comprehensive reports and statistics
BMEcat
ERP VDA
• Reduction of manual (error-prone) input
PDF Webplatforms / portals
OFTP1/2
PRICAT
(S)FTP POP3
• Monitoring of all processes
PPS SMTP
X.400
Fortras
Excel

PIM AS2
_data Authorities
Fax
EDIFACT
Suppliers
SAP IDOC

BDE AS/400 DataQueue

Service providers
Databases (freight forwarders etc.)

Branch offices / Network

etc.
© Lobster GmbH 2015 | 4 © Lobster GmbH 2015 | 5
Data Integration with Lobster_data Lobster_data:
7 steps to Data Integration
Lobster_data gathers all information required from any data sources defined In seven simple steps, Lobster_data transfers data generated by conversion, mapping or manipulation directly
Data source origin
by the user. It will actively request or accept delivery in an event-based to chosen target systems. The user is guided through the interface configuration by a wizard similar to that of
process. Microsoft Wizard.

This step processes any common data format in any character regardless
Data structure Step 1
of its encoding. Additional functions allow for data pre-processing before
mapping (e.g. PDF preparser).
Creating a profile
In Lobster_data, new interfaces are created
The data from the source data tree (input data) is converted to the target data
Data mapping as profiles. The user specifies a profile name
tree (desired output data). External systems, such as SAP, databases and so
and assigns the profile to a group (e.g.
on, can be accessed during the mapping process.
Customer A, Supplier B, ...).

Normally, data records are written to ERP or similar systems. Enter a validity period and click on
Write data
Optional:
Lobster_data allows writing records to any database in parallel. <Continue>
to the database

So called “integration units” control business-specific processing steps, TIP: You can store profiles as “master
Integration Unit templates”. Modifications to the master
generate reports in PDF or Excel and so on.
templates will be automatically transferred
to all profiles. A profile desired from a
The processed data is now transferred to selected target systems. master template can be individually
Data transfer
adapted, copied and modified.

Step 2

Specifying the data source

By choosing the “input agent” you determine from where Lobster_data will obtain the data you need to process.
For instance, for event-based processing, select FTP. If necessary, specify whether a ZIP file has to be unpacked
or whether a time driven event is to be activated for time-critical data. By specifying “Cronjob” (time driven events),
you determine when Lobster_data will collect data from chosen data sources.
Click on <Continue>

© Lobster GmbH 2015 | 7

 Step 3 Optional: Step 5

Define data structure Defining additional processing steps

By selecting the format (e.g. Excel, XML, CSV, This step will only be necessary if you want to
EDIFACT, SAP IDoc, ANSI X.12, FixRecord, etc.), introduce additional, business-specific processing
you define the type of data structure. steps. This can be PDF or Excel file generation,
the creation of reports or other online transactions
Select the appropriate character encoding and click on (customs, digital signature etc.).
<Continue>
Specify the appropriate settings and click on
<Continue>

Step 4 Step 6

Preparation for mapping Data transfer

To map the source data structure to the target data structure, Now specify by which transfer route (file, email,
either choose from the existing templates or create your own TIP: If Lobster_data does not provide a FTP, OFTP2, SAP ALE etc.) data should pass to
templates. All common industry formats (including EDIFACT, VDA, predefined template for your individual the target system. It is possible to select several
X.12, Fortras and many others) are available as standard. mapping, you can create your own. As different interdependent transfer routes.
well as easy-to-handle functions for tree
Define manipulations or additional functions by selecting a definded creation like drag & drop, copy & paste Define the target(s) and click on
or self-configured “filter” and click on <Continue> etc., templates can also be created in <Continue>
MS Excel and imported afterwards.

Lobster_data comes with more than

250 pre-defined filters that cover 98% of
all required manipulations and additions.
Customer-defined filters can be integra-
ted easily as and whenever necessary.
An additional time-saver is the import
of entire tree-structures automatically,
direct access to data-bases or third
party systems (ERP, CRM, Warehousing TIP: It is very easy to define escalation scenarios
… ) and much more. depending on whether the transfer of data has been
successful or not.

© Lobster GmbH 2015 | 8

 Useful optional modules:
Optional: Step 7

Notification in case of error Content Inspection

In this step you define the persons to be notified The optional module “Content Inspection” allows to merge data from different data
by email or SMS in case of data entry error (e.g. files or sources and to process them together. The contents can be analyzed and
mandatory fields not filled in, data not readable ... ). regrouped into different “data entities” following pre-defined rules. These can be
Click on <Save> when finished. processed afterwards with all the options available in Lobster_data and transferred
to other systems.
This process can also be specified in the
ControlCenter.
FaxService
With the aid of Lobster_data, you have now performed
successful data integration starting from any data Also available as an option is the “FaxService” module which adds functionality for
source to defined targets in just a few mouse clicks. sending and receiving fax messages. Incoming faxes can be converted, stored
or printed by Lobster_data. Processed data can be, among others, sent by fax. In
this case, the Lobster_data module works as a fully functional “fax gateway”.

DataFlow
As you already know, data
conversion is done in Lobster_data
Every step in Lobster_data is surprisingly simple, efficient and secure. All the steps are documented by using profiles containing all
automatically in the system, they can be tracked at any time and edited whenever necessary. of the settings and manipulation
rules. Having processed the data,
you can perform various tasks: if
a profile is configured for an ERP
system, it can afterwards transfer
data to other target systems too,
or generate reports etc. Profile A
can directly trigger Profiles B and
SAP-Integration using Lobster_data C etc. or can be routed from
Integration of data from SAP systems is becoming exceptionally easy. Lobster_data is able to communicate in profile to profile.
an SAP ALE environment with one or more SAP systems and to send and receive IDocs. Moreover, the data
converter is capable of making RFC calls directly to an SAP system and of processing the resulting data. DataFlow provides a graphical
The converted data can be sent to SAP via RFC or SAP ALE, and IDoc and RFC structures can be requested overview of this process. The
online. profile inter-dependencies are
displayed similarly to an organizational chart and can be modified within this chart.
Lobster_data provides ready-made tree structures for all standard SAP IDocs – an enormous time saving
for you! If many profiles exist in a system, it could be that the user assigns the wrong profile
to incoming data. In this case, processing would not be correct. DataFlow’s
simulation tool shows which profile would process which data in which order in a
clearly laid-out way. This makes the selection of the correct profile remarkably easy.

Another feature of DataFlow is the Process View in the ControlCenter. By

selecting individual jobs, the user gets an overview of how a profile is embedded
into the entire process. Errors or interruptions in the process can be – they are
marked in red by the system.

© Lobster GmbH 2015 | 11

 Data Security with Lobster_data

The automation of business processes requires detailed control of the individual tasks or operations. Monitoring
A comprehensive, user-friendly logging system is as important as proactive functions that notify relevant
staff of the data processing status. Moreover, it is essential to ensure that no data is lost at any time. Conventional “logging” means that extensive log files are searched using
a text editor. This is complex and often confusing. Lobster_data offers
These requirements are met by Lobster_data throughout the entire process and guarantee the highest another approach: only the information on the selected profile is displayed
possible transactional security. – limited to a specified period of time. Errors are displayed in a separate
list, along with all related messages. In addition, detailed search functions
and a clearly arranged display make finding information easy. Logs can be
defined at field level.

WebMonitor
Lobster`s WebMonitor clearly displays the information provided by the
ControlCenter using any web browser. Thanks to the integrated user
access management, business units, customers or suppliers can be
granted specific user rights and would be able to correct faulty input data
or start search queries.

Data Backup
Lobster_data stores all data in a backup. If an error occurs during further
processing – perhaps caused by network failures or incomplete data – the
entire processing operation can be tracked back, the error isolated, cor-
rected and the processing can be repeated.

Messages
On successful or faulty profile processing, Lobster_data sends messages
Central monitoring for IT personnel to the number of specified recipients. By using configuration filters, it is
via ControlCenter even possible to trigger messages during the mapping process.
This allows for an immediate and precise response to the
SmartPhone monitoring
for out and about current data.

Simplified monitoring via WebMonitor for business units,

customers, suppliers etc.

© Lobster GmbH 2015 | 12

Lobster_data makes all the Difference

Usability To write data directly to a database or to read data Multifunctionality Service

A survey of users showed that 90% of our customers for further conversion, Lobster_data immediately As a central data communication hub, Lobster_data Lobster is not only renowned amongst its customers for
rate Lobster_data`s installation and usability as “very integrates the fields of any database (e.g. MS SQL represents a single solution for all requirements: excellent software products for data conversion and
simple”. Thanks to a clearly structured graphical user Server, Sybase, Oracle, Informix, MAX DB, DB2, integration, data transfer as well as data communica- integration, but also its highly personal level of support:
interface, programming skills are not required. PostgreSQL and more) as a target structure. In fact, tion between ERP and CMS systems, databases, web Fast. Reliable. Outstanding technical expertise. In addition
Lobster_data imports the table structures from the platforms, customers and suppliers. to that, Lobster_data has an exhaustive online help
A wizard (similar to the Microsoft Wizard) guides you database and visualises them as a tree structure, function, as well as the “TeamViewer” connection.
through the easy to understand and intuitive appli- including all their relevant attributes. Lobster_data should be regarded not only as a
cation. Data manipulation is performed using a filter conventional data converter but rather as a Standard settings
system similar to that of MS Excel: instead of script Inside the mapping designer, all data structures (e.g. “middleware” between IT systems (ERP, PPS, PIM, The Lobster_data standard package contains over 4,000
programming, functions are assigned to appropriate standard structures such as EDIFACT, VDA, Fortras, accountancy, CRM, web shop ...) and customers, interface templates to ERP systems, as well as all relevant
fields or nodes. A “release-safe” implementation of PRICAT, but also individual structures from XML, MS suppliers, service providers, authorities, banks; industry standards (EDIFACT, SAP IDOC, VDA, Fortras,
business-specific functions is subsequently very easy. Excel, CSV etc.) can be freely modified in structure, irrespective of the nature of the data or the target ANSI X.12, &c.).
field definition and so on. system.
Documentation Lobster_data supports all common data transfer
Lobster_data automatically documents each creation During mapping and subsequently, Lobster_data Message structures protocols (e.g. (S)FTP(S), OFTP, OFTP2, SMTP, HTTP(S),
of an interface and/or a profile. In this way, there is allows selective splitting, conversion and output of Lobster_data provides automated pre-processing of SMS, SAP-ALE, IBM-DataQueue, AS2, X.400, WebDAV,
documentation for every interface which can be added large amount of data, following individually defined complex message structures. For example, messages SCP, SSH, Fax, WebServices (SOAP) ... ).
easily to your own comments. Independent of this criteria. can be split up into header and position records, and
automatic function, it is very easy to check up on an source data can be read starting from a defined line Version management
interface that has been created with standard filter In the development phase of mapping, it is possible to number or column. The Lobster_data´s approach to handling versioning in
functions. This can be compared to MS Excel, where test step by step and view the contents of variables relation to process and profile offers many significant
the functions assigned to the spreadsheet or the cells and mapping results in a preview. You can also load Platform neutrality advantages. A change in mapping will not necessarily
are easy to understand. test data into the source structure (this often facilitates As an open, platform-neutral system the graphical have an effect on all the other data transfer partners.
the identification of source fields) in order to visualise front-end of Lobster_data is compatible to the opera- Moreover, several process versions are available as
Of course, special business-specific functions can be the up-to-date data flow from data source to target. ting systems Windows, MacOS and Linux. The server backup. It is very easy and simple to re-activate one or
added to Lobster_data. These are also described in application supports all common platforms, starting more of the previous mapping or processing versions.
the automatic documentation function. If you need different versions of the same mapping with Java 5 (as well as Windows and Linux, among
for different data transfer partners, it is easy to copy others AIX and IBM i ) and can be installed to
Mapping an existing processing profile, mapping included. virtualised server environments. Integration with
Especially when configuring mapping, Lobster_data If necessary, partner information and relevant common databases (JDBC) is guaranteed.
offers considerable time-saving in comparison with mapping parameters can be modified in the copy
other systems, i.e. by providing pre-defined filters, (input/output) – another considerable time-saver. Performance
the automatic import of tree structures, direct access Even when processing several operations in parallel
to databases and third-party systems (ERP, CRM, In contrast to other software solutions, Lobster_data or dealing with enormous amounts of data,
warehouse systems etc.) and many more. follows the philosophy of mapping data from the Lobster_data offers extremely high performance.
target data structure to the data source. This
The connection between source and target data saves unnecessary creation of innumerable variables, Schedules (Crons)
can be established using “drag & drop”, by simply because source data can be addressed directly from Lobster_data provides very flexible options in
dragging values from the input data to the target the target field. configuring jobs through crontab-syntax (e.g. “every
data structure. last day of the month”, “every Friday” etc.).
Lobster UK
Dunston Innovation Centre
Dunston Road
Chesterfield
Derbyshire
S41 8NG
PHONE +44 (0) 114 3 991 551
MAIL info@lobster-uk.com
For more information visit
www.lobster-uk.com