Nice thing to use when working with CSV-files is CSV Kit.
See the file statistics: csvstat -e UTF-16 test.csv
Merge all files in a folder: csvstack -e UTF-16 -t *.csv > all.csv
Save column 2 to output .csv: csvcut -c 2 -e UTF-8 all.csv > output.csv
Data
By Greg Nowak, 21 January, 2016
Here is a great reference how to compress and reduce the size of PDF files with Ghost Scrip (gs) in Linux: http://blog.virtualzone.de/2012/11/how-to-reduce-pdf-file-size-in-linux…
Example: "gs -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/screen -sOutputFile=output.pdf input.pdf"
By Greg Nowak, 1 October, 2015
I have a couple of SMF forum sites I wan't to replace with Drupal, but there is a considerable amount of content, why I started to speculate if it could be done programmatically (semi automatic magic). I found a couple of outdated modules for merging data from SMF to PHPBB and then from PHPBB to Drupal. I tried that route once but did not succeed. The thing I would love to see is a transformation of the table data in the SMF database to CSV and then import it with the standard import module for Drupal Migrate.