Data Preparation tasks

- Data preparation tasks.…Now when we say data preparation tasks,…don't let us mislead you by the words!…What we really mean here,…is reaching external from the system…and going out and grabbing files,…such as doing a file transfer…over from an FTP server,…or going out and watching a certain file location…within our system or external to our system…and then transferring that file on over.…

It's Step One of our ETL.…Within preparation tasks we have…this terrific task called the Data Profiler.…Now what we're going to do with data profiling…is we're going to look at the data…and the metadata about the quality of that data,…and then we'll go through and look at…certain patterns, interdependencies,…and see if there's any redundancies…or if we have uniqueness, etc.…Word to the wise, the data profiler works only with SQL,…so we cannot bring in say, flat files,…but if you want to use the data profiler with a flat file,…then what you're going to need to do,…is bring that flat file into your system,…and then use the execute SQL task…