Jovian
Sign In

Exploratory Data Analysis: an end-to-end example

  1. How to work with the filesystem
  2. How to work with CSV files
  3. How to do exploratory data analysis (EDA)
  4. How to display images in a grid
  5. How to create a Kaggle submission file

1. How to work with the filesystem & directories

# You can use shell commands with "!"
!ls ../input
sample_submission.csv test train train.csv 
# Pipe output to do basic analysis
!ls ../input/train/ | wc -l
!ls ../input/train/ | head
124288 00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_blue.png 00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_green.png 00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_red.png 00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_yellow.png 000a6c98-bb9b-11e8-b2b9-ac1f6b6435d0_blue.png 000a6c98-bb9b-11e8-b2b9-ac1f6b6435d0_green.png 000a6c98-bb9b-11e8-b2b9-ac1f6b6435d0_red.png 000a6c98-bb9b-11e8-b2b9-ac1f6b6435d0_yellow.png 000a9596-bbc4-11e8-b2bc-ac1f6b6435d0_blue.png 000a9596-bbc4-11e8-b2bc-ac1f6b6435d0_green.png ls: write error: Broken pipe 
!ls ../input/train/00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_*.png
../input/train/00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_blue.png ../input/train/00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_green.png ../input/train/00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_red.png ../input/train/00070df0-bbc3-11e8-b2bc-ac1f6b6435d0_yellow.png