Data Integration Best Practices
Self Documentation
Challenge: How can I ensure the
documented to an acc
Solution: DI Studio self docume
in the job and transfo
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
executed warehouse code is
ceptable standard?
ents the code, based on descriptions in
orm properties.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Self
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
f Documentation
Meaningful Job names
Descriptions of “why” not just “what”.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Self
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
f Documentation
Use Notes and Document Attachments.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Self
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
f Documentation
Descriptions & Notes are propagated
through to the executable code,
benefitting production support teams.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Subjects:
Data Integration Structure
Data Integration Organisation
Capture Control (CCT Tables)
Error Monitoring
Data Validation
Data Protection (Scrambler)
Conformed Modelling
SQL Optimisation
Self Documentation
Role Assignment
Rename Standard Transforms
SAS DI Studio Version 3.4 under SAS In
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
ntelligence Platform 9.1.3
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Role Assignment
Challenge: How can I address wh
Solution: Use Role Assignment
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
ho is responsible for which job / entity?
in DI studio.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Role
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
e Assignment
Allocate names and roles where required.
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Subjects:
Data Integration Structure
Data Integration Organisation
Capture Control (CCT Tables)
Error Monitoring
Data Validation
Data Protection (Scrambler)
Conformed Modelling
SQL Optimisation
Self Documentation
Role Assignment
Rename Standard Transforms
SAS DI Studio Version 3.4 under SAS In
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
ntelligence Platform 9.1.3
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Rename Standard Transforms
Challenge: How can I keep track
of transformations.
Solution: Don’t use the default
default to something m
E.g. Rename “SQL Join” to “Merg
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
of processing in a job which has a lot
transform names, but rename the
meaningful.
ge Agent_Dim with Broker_Dim”
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Subjects:
Data Integration Structure
Data Integration Organisation
Capture Control (CCT Tables)
Error Monitoring
Data Validation
Data Protection (Scrambler)
Conformed Modelling
SQL Optimisation
Self Documentation
Role Assignment
Rename Standard Transforms
SAS DI Studio Version 3.4 under SAS In
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
ntelligence Platform 9.1.3
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Contributors
• Mick Collington
• Jethro Day
• Steve Morton
• Nick Treadgold
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Contributors
• Mick Collington
• Jethro Day
• Steve Morton
• Nick Treadgold
Data Integration Developer Group (
• Julien Heijster
• John Robertson
http://www.sasprofessionals.net/gr
forum/topics/data-integration-best
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
(SAS Professionals)
roup/dataintegrationdeveloper/
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
Data Integration Best Practices
Contributors
• Mick Collington
• Jethro Day
• Steve Morton
• Nick Treadgold
Data Integration Developer Group (
• Julien Heijster
• John Robertson
http://www.sasprofessionals.net/gr
forum/topics/data-integration-best
SAS.COM
www.definitivequality.com Copyr
SAS® Professionals Convention
14-16 July 2009
(SAS Professionals)
roup/dataintegrationdeveloper/
right © 2009 Defin itive Quality Solutions Limited. Registered in England No.:05141146.
The words you are searching are inside this book. To get more targeted content, please make full-text search by clicking here.
Data Integration Best Practices - Ning ... sas ®
Discover the best professional documents and content resources in AnyFlip Document Base.
Search