Connecting to Cloud Storage¶
- Centerprise - Enterprise Edition
- ReportMiner - Enterprise Edition
In this article, we will see how a user can create a shared connection to access and store files from and to the cloud in Astera ReportMiner. To browse cloud files in a report model, the report model should be a part of a project containing the Shared Action Connection.
Note: This feature of browsing files from the cloud only works in ReportMiner Enterprise and Centerprise Enterprise if the user has the Cloud Connector add-on.
Creating a New Cloud Connection¶
To create a new cloud connection in a project, you need to add a shared connection within the scope of that project. Once that is done, you can browse for cloud files from the Report Options panel in a report model that is present within the same project.
Exporting Data to a Cloud Destination¶
Here is how we can export our extracted data to an Excel or a Delimited file and save it on the cloud destination.
1. Go to Report Browser > Data Export Settings and select Create New Export Setting and Run (to Excel) option.
2. A configuration window will open. Click on the arrow next to the folder icon and select Browse Cloud Files option.
3. Locate the cloud directory where you want to save the Excel file, give it a meaningful name, and click Open.
4. The file path is now pointing towards the Amazon S3 cloud provider. Click OK.
5. The Job Progress window shows the job status and the cloud path where the destination file has been created.
6. If you want to create a Delimited File Destination, click on this icon in the Data Export Settings window and follow the same steps (step 2 onwards) as mentioned above.
Using Files from the Cloud in a Dataflow¶
We can access files from the cloud in a dataflow using the Report Source object. For that, the dataflow must be a part of the project or must contain a Cloud Storage Connection object pointing to the cloud location.
In this case, we will extract data from a file saved on a cloud location using a report model from the local directory.
1. Go to Toolbox > Sources and drag-and-drop the Report Source object onto the designer.
2. Right-click on top of the Report Model object header and select Properties from the menu.
3. Click on the arrow button next to the folder icon in the Report Location group-box to browse files from the cloud.
4. Locate the file in cloud directory and click OK.
5. The File Path is now pointing towards the Amazon S3 cloud provider. Click on the folder icon to browse the report model from your local directory.
Note: The report model must be a part of your project.
6. Click OK to close the window.
7. The Report Source object is now configured with a file path coming in from the Amazon S3 cloud connection and the report model from the local directory.
Right-click on the header and select Preview Output.
8. The Data Preview window shows that the file is correctly being read by the report model.
Using Files from the Cloud in a Workflow¶
We can access files from the cloud in a workflow as well, using the File System object. For that, the workflow must be a part of the same project as your shared connection.
In this case, we want to read all the files from a particular cloud directory (in a workflow) and extract data from those files to write it in an Excel Workbook Destination (in a dataflow).
We will do this by using the Report Source as a Transformation in a dataflow where we can parametrize the path of the file we want to extract data from using the Variables object. This is what the dataflow will look like:
Then, we will call the dataflow in a workflow using a Run Dataflow object and read the files from the cloud using a File System Items Source in a loop. We will send the cloud file path of the source file to the File Path variable in the dataflow as shown below.
Using File System Items Source to Browse Cloud Files¶
1. Go to Toolbox > Sources and drag-and-drop the File System Items Source object onto the designer.
2. Right-click on the object header and select Properties.
3. Click on Browse Cloud Folders to access the cloud folder from where you want to read files.
4. Here, we have selected the folder containing the source files from our Amazon S3 cloud connection. Click Open.
5. Our File Path is now pointing towards a cloud file path. Click OK.
6. Our workflow is now complete. Click on Start Workflow to run the workflow.
7. The Job Progress window shows the status of the job and the path of the Excel destination.
This is how you can create cloud connections and browse files from the cloud in Astera ReportMiner.