With Data Export, you can make an ad-hoc export of your data up to 5GB of data. The Data Export leverages our Snowflake data warehouse and is available for Railgenius Enterprise Customers.
Accessing the Data Export page
If you are a Railgenius Enterprise Customer, you can access the Data Export module directly from the homepage:
After clicking on the button, you'll be directed to the page, which looks similar to this:
Request an export of data
On this page, you can select a time range with multiple assets and with multiple message types to create an export request.
If you would like to request an export for multiple assets and multiple message types, select the desired items from the respective dropdown lists until your configuration is complete.
Please note that you can't add multiple items simultaneously. You must add the chosen assets and message types to your export configuration individually.
Message type
To request the data export, you need to find the message type that contains the information you are looking for. The easiest way is to search the Telematics data page, filter by locomotive then view the different message types and their contents.
After finding the message type on the telematics data page, you will need to use the same message type when requesting the data export.
Export formats
Two export formats are available:
CSV (is a table-like format that can be opened by data scientists in Jupyter Notebooks or imported into spreadsheet programs, such as Excel, Google spreadsheet, Libre Office Calc, etc. or in databases. CSV is a flattened view of the original database row)
JSON (provides the original content of the events)
You can choose the export formats by clicking on "More parameters" and then tick the checkbox next to the format of your choice.
In the case of nested data, the CSV file will be flattened, while the JSON will be nested. The JSON is the same as the one received via the generic KAFKA interface.
Submit your request and download the export
Once you configured your export, you can submit your request by clicking on the blue "Continue" button.
Before sending your request, you're offered the possibility to review the configuration. The requested export will be automatically sent to your email address. If you wish, you can add other recipient(s) as well. Once finished, hit the blue "Send request" button.
Once submitted, you will receive a confirmation email which informs you that your request has been received and is being processed. Once the request is completed, you'll receive another message with a download link to the export, which should arrive in your mailbox less than 24 hours after the submission of your request. As we are using a Snowflake data warehouse to make such exports, the queries run only once a day at night.
The link will expire after 3 downloads and can't be increased.
Export history
A history of the exports is also available on the web interface.
The status of the request can be queued, ongoing, failed or done.
Data limit
Your data export has been limited by default to 5GB per company in the last 30 consecutive days. The limits are set on the total size of data exports completed, ongoing or queued made by all users in your company.
If you wish to extend this limit, please contact our Sales team.
If the limit is reached or exceeded, a warning will be displayed on your screen. In this case, you can make your export requests with fewer assets at a time or with a shorter date range to stay under the maximum file size and under the 30-day data limit.
Due to data volumes, the data export is not meant as a continuous and complete data integration tool, and thus the volume of export is limited to serve your ad-hoc data science needs.
In order to achieve continuous data integration, we offer either:
a JSON event-based streaming via our generic KAFKA interface or,
a big data SQL interface via Snowflake Datashare
Please contact our Sales team if you would like one of those 2 options enabled.
Redirection
If you select data older than the agreed time limit for your company, as described in the following article, you will be redirected to the data export.
On the telematics data page:
On the Data Inspector page:
On the GPS history page:
Support
Do you still have questions? Go to the Railnova platform and click "Contact us" for help!
