Jobs
Repeating a Stage using Queued Datasets
Sometimes when building maps, it becomes necessary to call a stage multiple times to process a subset of nested data. Take for example an Origin which may return an Account, but then also a list of Contacts in a structured format (such as JSON). To ...
Writing to a local CSV from the StarfishETL Cartographer
Even though more and more services are moving to cloud-based solutions, often times we still need to interface to on-premises software using CSV files. To do this using the StarfishETL iPaaS system, you'll need to set up a Starfish Ray. A Ray will ...
Setup integration update frequency (schedules)
Setup integration update frequency (schedules) While in StarfishETL Cartographer, navigate to the Projects tab Select the “HubSpot & Creatio Integration” Project Select the Jobs Tab Select the “Select the HS Contact -to- CRM Contact” job Select ...
Queued Stages
Queued Stages are a useful feature for aggregating data or supplying "structured" data. Often systems will expect to have data bundled up and submitted all at once. A good example of this is how many ERP systems expect Sales Orders to be submitted. ...
Previewing Jobs
Before running a job for the first time, you can check to make sure all your formulas and translations are working correctly by stepping through each row on the Preview tab. No data will be modified in your destination system, and you may click Log ...
Run Job Options
Definitions/explanations of the different options for when you wish to run a job. Option Name Description Begin at Row Begin at Row/Leave blank to start at the first row. End at Row End at Row/Leave blank to process through to the end of all rows. ...
Creating a New Stage
Creating a Stage Under the mappings tab there is a bar titled stages. At the very end of the stages bar (on the right of the screen) there is a button with a + and what looks like a bulleted list, click this button and the New StarfishETL Stage menu ...
Configuring the Origin and Destination
Configuring the Origin The Origin is the data SOURCE that will be used in a job. You can choose from SQL, XML, OLE DB, ODBC, or SOAP. To get to the origin tab first select the project, then a job and finally select the origin tab. For MS SQL database ...
How to Chain Jobs
Select the next job you want to run when the currently selected job is finished. This works with scheduled jobs and the chain jobs checkbox on the run job tab. This is useful if you are building an integration or migration and want to chain together ...
Cross-reference (Xref)
StarfishETL has built-in methods for maintaining relationships between different systems. Put simply, you will be storing an ID from your Origin, and the new corresponding ID from your destination for the record. For example, if you are migrating ...