Data

Nice thing to use when working with CSV-files is CSV Kit.

See the file statistics: csvstat -e UTF-16 test.csv

Merge all files in a folder: csvstack -e UTF-16 -t *.csv > all.csv

Save column 2 to output .csv: csvcut -c 2 -e UTF-8 all.csv > output.csv

Here is a great reference how to compress and reduce the size of PDF files with Ghost Scrip (gs) in Linux: http://blog.virtualzone.de/2012/11/how-to-reduce-pdf-file-size-in-linux…

Example: "gs -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -dCompatibilityLevel=1.4 -dPDFSETTINGS=/screen -sOutputFile=output.pdf input.pdf"

I have a couple of SMF forum sites I wan't to replace with Drupal, but there is a considerable amount of content, why I started to speculate if it could be done programmatically (semi automatic magic). I found a couple of outdated modules for merging data from SMF to PHPBB and then from PHPBB to Drupal. I tried that route once but did not succeed. The thing I would love to see is a transformation of the table data in the SMF database to CSV and then import it with the standard import module for Drupal Migrate.