JSON to CSV

with support for nested structures (with auto schema)

Install

• install required packages pip install -r requirements.txt

Steps

• run python3 main.py
  • required --input <dir of input json>
  • required --output <dir of output csvs>
  • (optional) --delimiter "|", change seperator/delimiter , default is |
  • (optional) to merge all json to single csv --single, default is one set of csv files for one json
  • (optional) # of records to check records for all headers --metadata <number or records> defaults to 1000
  • required --join-column <column name from first level to use as merge column>
  • required --name <base-name of data>

examples

• default with | as delimiter
  • python3 main.py --input /var/tmp/input --output /var/tmp/outputs --name transactions --single --metadata 1000 --join-column origin_id
• use comma (,) as delimiter
  • python3 main.py --input /var/tmp/input --output /var/tmp/outputs --name transactions --single --metadata 1000 --join-column origin_id --delimiter ","
• use tab (\t) as delimiter
  • python main.py --input /var/tmp/input --output /var/tmp/output --single --metadata 1000 --join-column origin_id --name oopsy --delimiter "$(echo -en '\t')"