20110331

cfv

"cfv is a utility to both test and create .sfv, .csv, .crc, .md5(sfv-like), md5sum, bsd md5, sha1sum, and .torrent files. These files are commonly used to ensure the correct retrieval or storage of data.

cfv is written in python, and as such should run on all platforms python supports. Currently, it has been verified to work on linux, freebsd, openbsd, netbsd, solaris, macosx, and windows."

  • supports testing and creating of .sfv, .csv(2, 3, and 4 field variants), .crc, sfvmd5(sfv file using md5 instead of crc32), md5sum, bsd md5, sha1sum, and BitTorrent file formats
  • test-only support for PAR and PAR2 files
  • automatic checksum file naming ability in create mode
  • recursive operation
  • show unverified files option
  • ignore case and fix path seperator options for cross platform use
  • transparent gzip support for checksum files
  • configurable renaming of bad files (with testing against previous bad files, to save only unique differing copies)
  • searching for/fixing of misnamed files
  • raw listing of files of specified type (bad, missing, etc)
  • test suite to ensure correct operation

http://cfv.sourceforge.net/

20110302

DSPL: Dataset Publishing Language

"DSPL is the Dataset Publishing Language, a representation language for the data and metadata of datasets. Datasets described in this format can be processed by Google and visualized in the Google Public Data Explorer.

  • Use existing data: Just add an XML metadata file to your existing CSV data files
  • Powerful visualizations: Unleash the full capabilities of the Google Public Data Explorer, including the animated bar chart, motion chart, and map visualization
  • Linkable concepts: Link to concepts in other datasets or create your own that others can use
  • Multi-language: Create datasets with metadata in any combination of languages
  • Geo-enabled: Make your data mappable by adding latitude and longitude data to your concept definitions. For even easier mapping, link to Google's canonical geographic concepts.
  • Fully open: Freely use the DSPL format in your own applications"


http://code.google.com/apis/publicdata/