To parse Variable Column files with the Extensible Common Data Adapter (ECDA), you need to specify a location for the file to be read, a separator character (such as a comma or a pipe), and VCLP for parser.
Note: Unless you are using the VCLP parser for legacy purposes, the - CSV option will most likely suit your needs better than the VCLP option. Because you can use any separator with the CSV parser (not only commas), the CSV option generally offers more flexibility than the VCLP.
The Variable Column Log Parse splits an input string into fields separated by a delimiter character or delimiter string. It can handle comma-separated values, tab-separated values, or values separated by any other character. Column names cannot be dynamically assigned with Variable Column files. You need to declare these as part of a the foreign stream or table.
You can also input data in larger chunks and parse it later using the Parser UDX. This UDX calls the parsers listed above in a function. For more information on using functions, see the topic Transforming Data in s-Server in this guide.
The s-Server trace log includes information on readers’ and parsers’ progress. See Periodic Parser Statistics Logging in the Administering Guavus SQLstream guide.