How to work with datasets on LensAI™

Datasets

The basis for all work on the LensAI platform are the datasets that contain your data. Datasets belong to an organization and can be viewed by all users within the organization. A dataset can contain files, folders, and subfolders. A dataset can be in one of five states: active, processing, faulty, inactive and deleted. The organization is charged on a monthly basis for the storage of the datasets on the LensAI platform.

How to upload a dataset

From the “Home Page” of the LensAI portal, you can upload a dataset by clicking on the “Upload +” button on the top of the screen. Inside the pop-up you can give your new dataset a name and add files or folders from your local computer. After selecting all the files and folders for your dataset, click “Continue”. In the overview, check that you uploaded all the desired files and hit the checkbox to acknowledge the additional monthly cost for the dataset storage. Finally, click the “Save Dataset” button to upload your dataset.

Accessing the dataset management

From the “Home Page” of the LensAI portal, you can view your organization’s datasets by clicking the “Applications” button on the top of the screen. This will redirect you to the applications page. From this view you can access the dataset by clicking on the “Datasets” button under the management category in the left navigation column.

Dataset states

A dataset can be in one of five states: active, processing, faulty, inactive and deleted. The active state denotes the normal state where a dataset is viewable and can be used as input in applications. The processing state is used for datasets that are being produced as part of the output of a running application. The faulty state is used for output datasets of applications that failed during their execution. These datasets are not usable as an input for applications. The inactive state denotes datasets that are still viewable but can no longer be used as input in applications. The deleted state denotes datasets that were previously inactive and have been permanently removed.

How to inactivate a dataset

Organization users can mark a dataset inactive to prevent it from being used in applications. You can do this by navigating to the dataset management page, see instructions in “Accessing the dataset management” above. From the dataset management view, you can mark a dataset as inactive by clicking the three dots next to the dataset and selecting the “Deactivate dataset” button. Inside the pop-up, click the “OK” button to complete the inactivation of the dataset. 

How to reactivate a dataset

Organization users can mark an inactive dataset as active again to allow for its use in applications. You can do this by navigating to the dataset management page, see instructions in “Accessing the dataset management” above. From the dataset management view, you can reactivate a dataset by clicking the three dots next to the dataset and selecting the “Reactivate dataset” button. Inside the pop-up, click the “OK” button to complete the reactivation of the dataset. 

How to delete a dataset

Admin users can delete a dataset if they want to remove it entirely from the organization. You can do this by navigating to the dataset management page, see instructions in “Accessing the dataset management” above. From the dataset management view, you can delete an inactive dataset by clicking the three dots next to the dataset and selecting the “Delete dataset” button. Inside the pop-up, click the “OK” button to confirm the deletion of the dataset and all its files permanently. Be aware that dataset deletion is irreversible.

How to upload a dataset from other sources

Besides creating a dataset from local files, you can also upload data from AWS S3, FTP or HTTP links. You can do this by navigating to the dataset management page, see instructions in “Accessing the dataset management” above. To create a new dataset, click the “+ Add Dataset” button and select your desired source. In the pop-up, fill in the connection details and select the desired files. After selecting all the files and folders for your dataset, click “Continue”. In the overview, check that you uploaded all the desired files and hit the checkbox to acknowledge the additional monthly cost for the dataset storage. Finally click the “Save Dataset” button to upload your dataset.

How to download a dataset

To download a dataset, click on the arrow button in the dataset management page. You are then taken to the dataset details page. If dataset downloading is enabled for your organization, you can click the “Download Dataset” button.

How to view the dataset content

To view the content of a dataset, click on the arrow button in the dataset management page. You are then taken to the dataset details page where you can see all the files and folders in the dataset. By clicking the view icon, you can see the content of the files. For various file formats, the LensAI portal provides supported file viewers that give insight into the file content.