Writing to a local CSV from the StarfishETL Cloud

Writing to a local CSV from the StarfishETL Cloud

Even though more and more services are moving to cloud-based solutions, often times we still need to interface to on-premises software using CSV files. To do this using the StarfishETL iPaaS system, you'll need to set up a Starfish Ray. A Ray will allow the us to interact with the local computer where it is installed. Once you can configured the Ray and confirmed it is online, follow these steps to set up a job to write to a CSV file on the local machine.

  1. Create a new connection - use the Connection Type of "CSV via Upload", and ensure that you select your new Ray.

  2. Create a new job, your origin may be anything you want to write to the CSV file. For the Destination, select your new CSV connection.
  3. Create a new stage, in the Table enter the name of the CSV file that you want to be created. It is likely nothing will show up in the dropdown - you will have to manually type it in.
  4. If the file does not currently exist on the Ray machine, the Stage will initially show up with no fields to map to. To get around this limitation, you may manually enter the names of the columns you want to map to in the stage's User-Defined Field List box.

  5. Map your fields as you would for any normal job and run.
  6. By default, the file will get created in a new 'Files' folder inside you StarfishRay folder (C:\StarfishRay\Files). You can override this path by editing your CSV connection and entering an Additional Connection String Parameter of "URI=D:\data\csv" - edit the path as required.

    • Related Articles

    • CSV Connector

      Additional Documentation This Connector is based on the CSV ADO.NET Provider by CData. For additional help, including Connection String parameters, please see: https://cdn.cdata.com/help/RVG/ado/ CSV Via Upload (in Cloud Designer) When you upload a ...
    • Setting up your CSV via Google connector

      Create CSV via Google Drive connection Authenticate your connection using OAuth Select the google account you want to use Select the Advanced option to continue Select the Starfish ETL link to continue Access has been granted Select Query Builder to ...
    • StarfishETL iPaaS Logging Features and Settings

      StarfishETL iPaaS Logging Features and Settings StarfishETL iPaaS has a number of options for logging and monitoring integration activity. Logging is required at various stages of the integration mapping process, during the testing phase prior to ...
    • StarfishETL security features

      StarfishETL security features     Compliance and data privacy ·       No data kept at rest on  StarfishETL iPaaS servers ·       Data in motion is encrypted using HTTPS Infrastructure protection ·       StarfishETL iPaaS servers hosted on AWS  ...
    • StarfishETL Updater

      Update Wizard StarfishETL has a built-in updater. To start, click the Starfish button and select “Check for Updates” or launch StarfishUpdater.exe directly from within the Connect Creatio Admin installation path. NOTE: It is often times necessary to ...