Sunday, February 24, 2019

Explanation on Talend Functional Architecture

This article explains how a Talend Functional Architecture and Project creation to Execution works. Here I'm using a flow diagram as it will be easy to understand the flow through it. Also note that here I'm considering the components which are mainly involve when we design a project through Talend Studio.

Note: The Talend 5.6.1 considered when analyzing the flow and here I'm specifically going through the flow where Artifacts loaded to Nexus and then retrieving it to execute. There are another two ways to load and execute the projects:
1) Export and Upload the Project to Job Conductor
2) Execute directly from Talend Studio.

Here in the below diagram:
Blue Font:  Explains the flow when creating users and providing authorizations.
Green Font: Explains the flow when creating and designing the project.

H2 Database
( Can modify to use other Databases )
SVN
Holds the User accounts 
related Data 
Talend Administration Centre 
( Running on top of Tomcat )
Holds Project Related Data
( Running on top of Apache )
Talend Job Server
Talend 
CommandLine
Exact copy of theTalend Studio running
 in a headless non-GUI mode
Talend Studio
4. Load the project through TAC from SVN
and design the project
3. Project related data will
be persisted in SVN
4. User Information and Authrorization
Information will be stored to Database.
Job Conductor
Talend Administration Centre 
Console
3. Data Persistence
Repository
http://localhost:8081/nexus
1. Log into Talend Administration Console
2. Create a users for providing access for projects 
http://localhost:9080/org.talend.administrator
1. Create a project through TAC Console
2. Project will be created into SVN
5. Save the project
6. Updated project design will be persisted
in SVN
7. Publish the project 
8. Project artifacts will be published to Nexus Repository
9. Retrieve the project into Job Conductor from Nexus
10. Deploy the Project into Job Server through
Job Conductor and Run the Project.

References

[1] https://help.talend.com/reader/kj4pY1SkKiM4v91iTLuI3Q/NIYCD0QApSsXDzTkhMcXXg
[2] https://help.talend.com/reader/kj4pY1SkKiM4v91iTLuI3Q/RAQIxfznH6FF4A8AvlxK4Q
Posted by at No comments:
Subscribe to: Posts (Atom)