CloudNine Discovery Portal - CloudNine Review: How do I process eDiscovery raw (unprocessed) data to load into CloudNine Review?

Process eDiscovery data to CloudNine Review using this simple, easy-to-follow workflow in CloudNine Discovery Portal.

CloudNine Discovery Portal is the gateway to uploading, processing and reviewing your data in CloudNine Review. Follow these simple steps and your data will be available in CloudNine Review in no time.

DPFileSystemToCloudNineReviewPlay

Video: CloudNine Discovery Portal: File System to CloudNine Review (Raw data) Workflow

Workflow Diagram 

Step 1: File System - CloudNine Review - Unprocessed (raw) Data

Step 2: Upload to CloudNine Review: Upload Name and Case

Step 3: Select/Create Custodian and Select Data for Upload

Step 4: Pre-Upload Filtering

Step 5: Confirm & Upload

Workflow Diagram

FileSystem Raw (Unprocessed) - Copy

Step 1: File System - CloudNine Review - Unprocessed eDiscovery Data 

When you launch CloudNine Discovery Portal, you are presented with several workflows. If you have raw (unprocessed) eDiscovery data or processed data with corresponding load files, the File System - CloudNine Review workflow is used.  

  1. Double-click the CloudNine Discovery Portal shortcut to launch CloudNine Discovery Portal. The Welcome to CloudNine Discovery Portal screen appears. 
  2. On the Welcome (Home) screen, under Select Data From: choose the first option, File System (e.g., File Share, Hard Drive, Forensic Image, etc). 
  3. When File System is selected, the Review Data Using: options become available. By default, CloudNine Review is selected. Verify the Select Data From: File System and Review Data Using: CloudNine Review is selected, then click Continue
    DiscoveryPortal-Welcome
  4. At this time you are prompted to log in to CloudNine. Enter your Email address and Password used to log in to CloudNine Review, then click Continue. 
    logintoCloudNine1
  5. The Verify Your Identity using Auth0 Guardian app popup appears. Select the option you have in place for CloudNine Review multi-factor authentication method and verify. See Creating Your Multi- Factor Authentication to learn more about multi-factor authentication.

    VerifyIdentity1
  6. Once your identity is verified, the What kind of data are you uploading? overlay appears. There are four options: 
    1. Native/Raw data: Data that has not undergone any processing to expand container files, extract metadata, extract native files, or extract text files. This is eDiscovery data in its original collected format.
    2. Production/Processed data: Data has undergone processing and contains the corresponding .DAT load files for metadata, along with links to the native and text files. If images exist, a .LFP or .OPT file is available for image uploads.
    3. UFDR Cell phone data is provided in a UFDR file, a summary report of data collected from a smartphone or other smart devices. 
    4. Modern Data Load File: Data collected from cell phones, group messages, social media, etc and provided in a delimited load file format such as a CSV or DAT file.
    Select Native/Raw Data then click OK to advance to Step 2: Upload to CloudNine Review: Case Selection and Custodian screen. 

    Native_Raw Data Upload

Step 2: Upload to CloudNine Review: Case Selection and Upload Name

After launching CloudNine Discovery Portal, connecting to CloudNine Review, and choosing the data upload type, Native/Raw Data, the next screen is Upload to CloudNine Review: Case Selection and Custodian. On this screen, you will select an existing CloudNine Review case (project) and enter an Upload Name. A new CloudNine Review case (project) can also be created here. 

Overview: Upload to CloudNine Review

Upload to CloudNine Review - Existing Case

Create a New CloudNine Review Case

Overview: Upload to CloudNine Review

CaseUpdateandSelection

  1. Upload name (Required): Enter an Upload name to use as a reference for the upload. The maximum number of characters is 100.  This information is captured in the Upload Name field in the CloudNine Review Project. 
  2. Case Name: Lists all CloudNine Review projects you are enrolled in as an Admin. 
  3. Search Cases...: Use this option to search and locate a CloudNine Review case (project). The search is fuzzy and begins returning case names that relate to the character(s) entered in the search box. 
  4. Create Case: If the case does not already exist in CloudNine Review, you can Create a Case through CloudNine Discovery Portal. The case is temporary and not created in CloudNine Review until data is received in the CloudNine Review environment.  
  5. Case Name (Required): List of CloudNine Review cases you have Admin rights to access and load data.
  6. Selected: When the case is selected, it is highlighted, and a checkmark appears in the Selected column. 
  7. Home: Returns you to the Welcome screen. 
  8. Next: Advances you to the next screen, Step 3: Select Data for Upload

Upload to CloudNine Review - Existing Case

Now that you are familiar with the Upload to CloudNine Review screen,  you can proceed with entering an Upload name and selecting the Case the data will be loaded into. 

  1. Enter the Upload name. The Upload name should follow the naming policy you have implemented for uploading data to CloudNine Review. 
  2. Select the CloudNine Review case from the Case Name list.
    1. Use the Search Cases... option to quickly find your desired case; the fuzzy search updates the list as you type.
    2. Create Case: Use this option if the case is not listed and you have verified the case is a new case and does not exist in CloudNine Review. 

      UploadName_Case
  3. Once you have entered the Upload Name and selected the CloudNine Review Case, click Next to advance to Step 3: Select Data for Upload. 

👥 You must have Admin rights in the CloudNine Review case (project) you wish to upload to. If you do not have Admin rights, the case does not appear in the Case Name list.👥

Create a New Case in CloudNine Review

It is possible to create a CloudNine Review case through CloudNine Discovery Portal.  

When creating a new case through CloudNine Discovery Portal:

  • In CloudNine Review, verify the case does not exist. It may be that you do not have the correct permissions to upload data to the case. When importing to an existing case (project) you must have admin rights to that project. 
  • Confirm you have access rights to create a case in CloudNine Review. To create a new case you must have admin or user rights. 
  • Maintain the Case naming policies you have implemented for CloudNine Review. 
  • A CloudNine Review case created through CloudNine Discovery Portal is temporary, the case is created in CloudNine Review when the upload process completes and the data is received by CloudNine Review. 
  1. On the Upload to CloudNine Review screen, click the Create Case button on the right. 
    createCase
  2. The Create new case overlay appears. 
  3. Case Name (Required): Enter a name for the CloudNine Review case, based on your CloudNine Review case naming policy.  
  4. Time zone: If the default is incorrect, select the correct time zone from the drop-down.
  5. Click Create to create the case.
    DP_C9RNewUser-1
    The case is now found under the Case Name list and is selected by default. The case appears italicized, indicating it is temporary and will only be created upon receiving data by CloudNine Review.

    SelectCase
  6. Enter the Upload name, confirm the Case selection, and click Next to proceed to Step 3: Select Data for Upload.

Step 3: Select/Create Custodian and Data for Upload

 On this screen, there are two sections: Select/Create Custodian and Select Data for Upload

SelectCustodianData
  1. Select/Create Custodian: Here, you will choose the custodian for the data you are loading or select Create New from the drop-down, then enter the Custodian name. Only one custodian can be assigned to the data selected for upload.
  2. Select Data for Upload, choose the data to upload to the CloudNine Review case. Select folders/files using either of the following options. 
    1. Drag and drop any number of files and folders into the area marked Drag files & folders here to add files.
    2. Select the Browse... drop-down and select either Add files... or Add folders... to navigate and select the files/folders you wish to upload to CloudNine Review. Once selected, choose Open (files) or Select Folder (folders) in the bottom right corner.Select Data for Upload, choose the data to upload to the CloudNine Review case. Select folders/files using either of the following options.

SelectCustodian1

Discovery Portal lists all files found through file selection or selected folders. You can continue to add files via drag/drop or browse file/folder selection methods until you have selected all the files you wish to upload. 

  • To view the entire path and filename, hover your cursor pointer over the file. 
    selectedfilesfullpathandname-1
  • Removing a file: Remove unwanted files by selecting the file from the list and clicking the trashcan icon. This file is removed from the list and will not be included in the upload. 

3.    Once you have selected the files, click Next to advance to Step 4: Pre-Upload Filtering.

Step 4: Pre-Upload Filtering

The Pre-Upload Filtering screen allows you to inventory and analyze your data before uploading.
You can cull data by folders, file type, specific files, or date range to exclude it from processing and uploading to CloudNine Review.

Overview of Pre-Upload Filtering

No (default) - I do not want to cull data prior to processing 

Yes, I want to take an inventory of my data and determine if any filtering will be performed before the upload

💡 Use the Pre-Upload Filtering to obtain preliminary reports about the data. This information can be useful to determine priority order based on folder/directory structure and if any pre-upload exclusions (culling) may be implemented based on file type or date range filtering.    

Overview of Pre-Upload Filtering

PreUpload1

  1. Yes: Enabled a file type inventory is performed, based on file extension. 
  2. Use Enhanced file type identification: This option inventories files based on the unique signature (file header) instead of the file extension. 
  3. No: Selected by default, data will not be inventoried and culling options will not be available. All selected files are uploaded.  
  4. Next: Takes you to the next screen. If you select Yes, the next screen is the Source selection overlay, then the Pre-upload filtering screen. If you chose No, you are directed to the Step 5: Confirm & Upload page. 

No (default): I do not want to inventory and/or cull data prior to processing 

Pre-Upload Filtering is an option available to you, but is not necessary. If you are familiar with your data and do not wish to exclude anything bypass inventory and filtering and proceed to the final step. 

  1. Under Do you want to cull data prior to processing, enable No (selected by default). 
  2. In the bottom right, click Next to proceed to the Step 5: Confirm & Upload screen. 

Yes, I want to inventory my data and determine if any filtering will be performed before the upload

The Pre-Upload Filtering feature in CloudNine Discovery Portal allows you to inventory your data and exclude files based on folders, file types, individual files, and date ranges before the upload process begins. Excluded files will not be uploaded or processed in CloudNine Review.

Inventory your Data

  1. On the Pre-Upload Filtering screen under Do you want to cull data prior to processing, select Yes - the defaulted option is to inventory by file extension
    1. When Yes is selected, the default option is to inventory by file extension. While this is the quickest method for file type inventory, it may not be accurate as it relies solely on the file extension.   
    2. Use Enhanced file type identification: This provides a more accurate file inventory method. It examines the file's unique header signature for accurate type identification, rather than relying on the file extension. With this feature selected, inventory time will take longer, but the results of the file-type inventory will be more accurate. 
      FileFiltering
  2. You have already selected Yes to inventory your data. Now, choose if you want to Use Enhanced file type identification (increases inventory time), then click Next at the bottom right to move to the Source Selection Progress overlay.

Source Selection Progress

The Source Selection Progress overlay indicates the inventory process has initialized. As files are retrieved, information about the inventory progress is displayed. 

SourceSelection1

If at any time the information appears to be inaccurate, or you decide you want to stop the inventory process, click the Cancel Selection cancel selection button on the bottom right to cancel the inventory process.  If you choose to cancel, you are returned to the initial Pre-Upload Filtering screen.  At this time, you can go Back to select/remove data or simply choose a different inventory option. When the inventory process completes, the Pre-Upload Filtering Inventory Results screen appears. 

Pre-Upload Filtering Inventory Results

Once the file inventory process completes, the Pre-Upload Filtering screen displays the results. At this time, you can review the data and determine if you want to Cull (exclude) any data before uploading. There are three tabs on the Pre-Upload Filtering Screen:

  • Folders/Directory: Select or deselect entire folders from your dataset. Folders containing files are selected by default.  
  • Date & File: On this tab, you can 1). Filter by file type, 2). Apply a date range, and/or 3). Select/deselect by individual file(s). 
  • Mailstore: Review PST files and their content. You will need to visit the Mailstore tab at least once after the inventory completes to retrieve Mailstore data. 

Folders/Directory

The Folders/Directory tab displays the directory structure and folders identified during the inventory process. By default, all folders are selected to include in the upload. 

PreUploadFilterTab

  1. Tabs: The three tabs provide various culling options for Folder/Directory, Date & File, and Mailstore.
  2. Folder name: Displays the directory structure of the selected data. All folders found are listed, along with the number of files contained in the folder.
  3. Include: Indicates what folders are included for the uploaded. By default, all folders are checked to include during the import process. De-select (uncheck) an entire folder or subfolder to exclude from the upload. 

💡 Want to start reviewing sooner? Consider uploading in "batches"  by including/excluding specific folders based on size or priority. For example, if the directory is organized by custodians then you can prioritize which custodian to import first. 

  1. Review Folder information and de-select (uncheck) any folders you do not want to include during the import.
  2. After excluding any folders/subfolders from the upload, click Next or select the Date & File tab. 

Date & File

On the Date & File tab, you can choose to exclude files by File TypeIndividual Files, or Date Range

Overview Date & File Tab

File Type and/or File Filtering

Date Range Filtering

Overview Date & File Tab

DateFileFilter
  1. File type: Lists all file types identified during inventory. Click on the file type to expand and see the list of files. If you are unable to see the entire path and filename, hover over the file to display the remaining path and filename. 
    Pre-UploadFilter_filetype expand
  2. Total Count/Size: The number of files and total filesize for that file type. 
  3. Filtered Count/Size: When a date range filter is applied, this column indicates the number of files and total size for the file type that falls within the date range.
  4. Include Indicator: Indicates if files or file types are included. Indicators are: 
    • Check_IncludeAll All file types and files will be included in the upload. 
    • Filetypeexclusions-1Indicates some file types or files have been excluded.
    • ExcludedFileorType-1 Indicates the file or entire file type is excluded.  
  5. File Type Statistics: Provides a summary of the selected sources after any exclusions. 
    FileTypeStatistics
  6. Filesize Statistics: Provides statistics of the included file sizes. 
    FileSizeStatistics
  7. Export Report: Select Export Report and then choose either or both of the Available reports to export. There are two types of reports: 
    • Metadata Report: Generates a CSV of all files included for upload, detailing their File Path, Name, Extension, Type, Size, Created Date, Last Access Date, Last Modified Date, and Attributes.
    • File Type Report: A PDF file with information on the file types that are selected for upload. The report includes a Description, # of Files, Total Size (GB), Oldest Creation Date, Newest Creation Date, Percentage of Total File Count, and Percentage of Total File Size.
    • Select the report(s) and output location. When the reports are complete, use the Click Here option to open them. 
      ExportReports

       

      SourceSelectionReportsGeneration

       

  8. Filter by Date: If the scope of your project requires a date range filter, enter a Start and End date to upload data that falls within the selected date range. Data outside the date range are excluded from the upload. 
  9. Clear: Clears the date range filter. 
  10. Apply: Applies the date range filter. 
  11. Selection includes: Provides a summary of the number of files and file types included with the upload. This is updated as files or file types are excluded. 

File Type / File Filtering

The File Type column lists all top-level file types from the inventory, allowing you to exclude either entire file types or specific files. This feature is often used to exclude executable files and common system files. 

If you are excluding file types, it is recommended that you use the Enhanced File Type Identification to ensure better accuracy when excluding specific file types. 

File Type Filtering

  1. Review the file type list identified during the inventory process. By default, all files are checked to Include during the import. 
  2. Clear (un-check) the file type to exclude all files identified for that file type. Notice the "include" box is now cleared and Selection Includes... is updated to reflect the change.

Individual File Filtering

  1. Click the expand FileExpand  button next to the file type to see a list of the individual files associated with that file type. 
  2. If needed, hover your mouse over any file to see the entire path and filename. 
  3. Clear (un-check) all files you wish to exclude from import. In the Include column the Include header changes to reflect files that have been excluded. At the bottom, the Selection includes.... updates to reflect the changes. 

filetypeexpandedwithredacts

Date Range Filtering

The Filter by Date option on the right is used to include only files that fall within the specified date range.

💡 Use Data Analysis tools to export a Metadata report to review date fields and determine any date range filter to implement.  
DataAnalysisTools

To specify a date range, do the following: 

  1. In the Start Date box, click on any part of the mm/dd/yyyy and begin typing to enter a starting date or click the calendar icon to the right to open the calendar option. With the Calendar window open, navigate to select a date to use for the starting date. 
    • Click the Month/Year shown in the calendar header to scroll between years rather than months/days
    • Click Today at the bottom-right of the calendar window to set today's date as the starting date. 

      FilterByDate FilterByDate_MonthYear

       

      Month Selection

       

  2. Type the Start and End Dates, or use the Calendar option to select the dates. Once populated, click the Apply button to filter all files by the specified date range.  Once applied, you will see a Filter Applied status. The Filtered Count/Size column is updated to reflect the number of files and sizes that fall within the date range and will be included during the upload. 
  3. Use Clear to remove the applied date range filter. All files will be included for upload again unless excluded by file type or file filtering.

    DateFilter

The following Filetypes are Not filterable (as shown in the Filtered Count/Size column). By default, these file types are included. You can manually deselect to remove from upload.

    • BZip Archive
    • Gzip Archive
    • MBOX
    • Cabinet File
    • Java Archive
    • PKZip Archive
    • Forensic Image
    • Lotus Notes Store
    • RAR Archive
    • GNU Tar Archive
    • Lzip_Archive
    • SevinZip Archive

     

    For PST mailstore files, the effects of the Date Filter can be reviewed on the Mailstore tab. 

    Mailstore Filtering

    The Mailstore tab gives you the opportunity to review  PST files found within your data set. On this tab, you will see a list of PSTs, the number of messages, and the total file size.  When you expand the top mailstore folder you can see the folder organization of the mailstore. 

    Mailstore Overview

    Review PST Folder

    If one or more PST files are found to be corrupt, you will be notified at this time and can troubleshoot the problem.

    Mailstore Overview


    MailstoreTab1
    1. Folder type  (Folder Contents): Lists all PST mailstores in the dataset. 
    2. Contents: The root mailstore displays the number of messages in the PST as well as the size of the data. 
    3. Included/Excluded: Indicates if the folder and its contents will be included in the import. There are three status indicators: 
        • IncludedIncluded: Everything is included in the selection. 
        • ExcludeFile Excluded folder: The entire email folder is excluded from the upload. 
        • Filetypeexclusions Partial Include/Exclude: Some folders in the mailstore are selected for import or excluded.
    4. Expand / Collapse: Expand a PST mailstore to see the folder structure and organization of the mailstore. Collapse to return to the top folder. 
    5. Folders: The folder organization of the PST.
    6. Next: Select and move to the Confirm & Upload page.

    Review PST Folders

    1. On the Mailstore tab, review PSTs, Folders, and Content information. Identify and de-select any folder(s) that should be excluded from the import. If previously marked to exclude, simply click to include again. 

    MailstoreFiltering

    Your data has been inventoried, and you have gained insight into the data you will be uploading to CloudNine Review.  Filter options are applied based on the scope of your project.  Click Next to proceed to Step 5: Confirm & Upload

    Step 5: Confirm & Upload

    The Confirm & Upload screen is your chance to review information about the data that will be uploaded. 

    Confirm&Upload1

    1. Uploading From: File System:  Provides information about the number of files selected for upload and the size of the upload. 
    2. Uploading to: Displays the CloudNine Review Case and Custodian Name the upload will go to.
    3. Selected Items - PST and Folders (visible if inventory performed): Provides a summary of the PST mailstores selected for upload. 
    4. Selected Items - Other File Types (visible if inventory performed): This option provides a summary of the file types that will be included for import. 
      OtherFileTypes
    5. Notes & Comments: Optionally, type information about the upload here.  
    6. Start Upload: Initializes the upload. 

    Confirm &Upload 

    1. Verify Uploading From, Uploading To, and Selected Items information is correct. Enter optional Notes and Comments about the project.  
    2. If changes are needed, go Back to make any necessary adjustments to your document selections and filters. 
    3. Click Start Upload to begin. The upload process initializes and is monitored on the Global Monitor Console

    Global Monitor Console

    The Global Monitor Screen is used to monitor the upload progress through CloudNine Discovery Portal.  Once data is uploaded to CloudNine servers, the status on the Global Monitoring Console will reflect that the upload is complete and the processing to the CloudNine Review phase begins. You will receive status emails during processing, with a final email advising your data is ready in CloudNine Review. Click Global Monitor Console for additional information about the console. 

    GlobalMonitorConsole