Dernière mise à jour : 2011-11-24

Data Integrity Institute Inc.

Information sur l'entreprise

Dénomination sociale :   Data Integrity Institute Inc.
Nom commercial :   Data Integrity Institute Inc.
Adresse postale 10 Plumrose Blvd SCARBOROUGH, Ontario M1E 5E8	Adresse civique 10 Plumrose Blvd SCARBOROUGH, Ontario M1E 5E8
Téléphone : (416) 282-2298
Courrier électronique : info@DataIntegrityInstitute.com
Site Web : http://www.dataintegrityinstitute.com

Information sur les personnes-ressources

Drago Pejic
	Titre :   Fellow, Data Integrity Institute
	Téléphone :   (416) 282-2298
	Courrier électronique :   info@dataintegrityinstitute.com

Description de l'entreprise

Data Integrity Institute Inc. specializes in the research and development of advanced technologies for Corporate Metadata Repository, massive ETL, and Data Integrity management. Data Integrity Institute Inc. offers Copula ETL Appliance, a first Application Specific ETL Appliance. Copula ETL Appliance is a complete ETL solution, including most advanced hardware (with massive parallel multi core CPUs, fastest external and internal networking, parallel disk arrays), load balancing parallel operating environment, most efficient ETL engine, and custom build according user business specification, ETL solution. Copula ETL Appliance is guaranteed to be implemented and delivered within 3 months after business specification is submitted, without any development on the user side. Copula ETL Appliance will execute specified ETL task within 3 hours. Copula ETL Appliance provides full metadata information with every running session (also useful for eventual process reengineering of ETL process) and full data overexposure protection.
Pays propriétaire :	Canada
Année d'établissement :	2004
Exportation :	Oui
Certification de qualité :	ISO 14001 ISO 17025 NADCAP AS/EN 9100 AS/EN 9110 AS/EN 9120 AS 9003 AS 9006 DO-178B ISO/TS 16949 ANSI/ESD S20.20 ISO 9001 TL 9000 ISO 13485 ISO 22000 ISO/TS 29001
Industrie primaire (SCIAN) :	541710 - Recherche et développement en sciences physiques, en génie et en sciences de la vie
Autres industries (SCIAN) :	518210 - Traitement de données, hébergement de données et services connexes 541510 - Conception de systèmes informatiques et services connexes
Activité principale de l'entreprise :	Services
Total des ventes ($CAN) :	5 000 000 $ à 9 999 999 $
Total des exportations ($CAN) :	5 000 000 $ à 9 999 999 $

Produit / Service / Licence

Nom du produit :	Copula Application Specific ETL Appliance
Copula Enterprise ETL Appliance encapsulates all needed for an efficient ETL solution, relieving an end user of designing, implementing and deploying of an uncertain ETL application: - Most advanced hardware, based on the latest fast internal and external networking (Infiniband, Fiber Channel, Gigabit Ethernet), multi core CPUs, and large amount of RAM and storage, composed of standard available products and integrated to best serve massive ETL processes - Copula Enterprise ETL engine, that encapsulate extract, transform, and load of massive data vaults for simultaneous support for multiple sources and targets, error and reject handling, data cleansing, data lineage, structural, business and operational metadata and documentation generating, and data overexposure protection - Full ETL application, implemented according provided business requirement and specification http://www.dataintegrityinstitute.com/copula.htm Copula Enterprise ETL Appliance acts as a black box because it encapsulates all best composed and optimized hardware and software. Copula Enterprise ETL Appliance is guaranteed to be delivered within three months, after signing of the deal and the business specification is received. Copula Enterprise ETL Appliance guaranties to finish all ETL processes within three hours. Copula Enterprise ETL Appliance costs US$1,000,000.00 for first TB of data to be processed. For each next TB of data, Copula Enterprise ETL Appliance costs US$100,000.00 more, because three months of delivery and three hours of processing are still equally guaranteed. Long term maintenance and prompt support for eventual Change Requests are subjects of separate convenient contract.
Nom du produit :	Data Lineage
Data Lineage is a Data Integrity Institute Inc. metadata application that allows to travel forward (Daniel approach) or back (John approach) through corporate data and explore data origins and destinations. http://www.dataintegrityinstitute.com/Data_Lineage.htm No single vendor's Structural or Operational metadata scanner (either from ASG Rochade or third party) can create conditions for a complete corporate Data Lineage tracing and analysis. Data Integrity Institute Inc. implements a Data Lineage metadata application by customizing vendors' Structural and Operational metadata scanners and building of dedicated scanners for Business and other metadata. Scanned metadata are standardized and enriched with business integration attributes (purpose, abbreviations, etc.) and linked according business logic.
Nom du produit :	Enterprise Metadata System
Data Integrity Institute Inc. offers the most sophisticated metadata solutions built on the top of one of the world's most powerful metadata management engines, ASG Rochade, including most important metadata applications for data management: Impact Analysis, Data Lineage, Data Standardization, Regulatory Compliance, Data Overexposure Protection, Metadata Reporting. - Impact Analysis is a Data Integrity Institute Inc. metadata application that allows to explore impacts of particular changes in the data model (impacts of adding, changing or removing of database or business objects). - Data Lineage is a Data Integrity Institute Inc. metadata application that allows to travel forward (Daniel approach) or back (John approach) through corporate data and explore data origins and destinations. - Data Standardization is a Data Integrity Institute Inc. metadata application that allows full business oriented data integration, avoiding redundancy and bottlenecks. - Regulatory Compliance is a Data Integrity Institute Inc. metadata application that allows reasonable full compliance with Sarbanes - Oxley Act and other regulatory standards. - Data Integrity Institute Inc. offers several (Data Overexposure Protection, Islamic Banking, for example) or implements according specification Corporate Specific metadata applications. - Data Integrity Institute Inc. offers and implements according specification customized interactive and unattended predefined and ad hoc metadata Reports. http://www.dataintegrityinstitute.com/Enterprise_Metadata_System.htm
Nom du produit :	ETL project management
Data Integrity Institute Inc. provides on site competitive cost efficient ETL project management, either for new ETL projects or to save and successfully deliver an existing ETL project in jeopardy. http://www.dataintegrityinstitute.com/ETL_project_management.htm On site independent ETL project management will make an ETL project feasible and significantly save implementation time and money. Risks and bottlenecks early identification in an ETL project is very important because even major ETL tool vendors recommend best practice which non critical following can jeopardize an ETL project.
Nom du produit :	Impact Analysis
Impact Analysis is a Data Integrity Institute Inc. metadata application that allows to explore impacts of particular changes in the data model (impacts of adding, changing or removing of database or business objects). http://www.dataintegrityinstitute.com/Impact_Analysis.htm No single vendor's Structural or Operational metadata scanner (either from ASG Rochade or third party) can create conditions for a complete corporate Impact Analysis. Data Integrity Institute Inc. implements an Impact Analysis metadata application by customizing vendors' Structural and Operational metadata scanners and building of dedicated scanners for Business and other metadata. Scanned metadata are standardized and enriched with business integration attributes (purpose, abbreviations, etc.) and linked according business logic.
Nom du produit :	On site ETL seminars
Data Integrity Institute Inc. provides on site ETL seminars, ETL tool selection, ETL platform selection, ETL project review, ETL performances estimation, ETL obstacles and bottlenecks identification, ETL best practice revision, staff coaching and training. http://www.dataintegrityinstitute.com/on_site_ETL_seminars.htm On site independent ETL seminars will make an ETL project feasible and significantly save implementation time and money. Risks and bottlenecks early identification in an ETL project is very important because even major ETL tool vendors recommend best practice which non critical following can jeopardize an ETL project.

Profil technologique

Data Integrity Institute Inc. specializes in the research and development of advanced technologies for Corporate Metadata Repository, massive ETL, and Data Integrity management.

Data Integrity Institute Inc. offers Copula ETL Appliance, a first Application Specific ETL Appliance. Copula ETL Appliance is a complete ETL solution, including most advanced hardware (with massive parallel multi core CPUs, fastest external and internal networking, parallel disk arrays), load balancing parallel operating environment, most efficient ETL engine, and custom build according user business specification, ETL solution.

Copula ETL Appliance is guaranteed to be implemented and delivered within 3 months after business specification is submitted, without any development on the user side. Copula ETL Appliance will execute specified ETL task within 3 hours. Copula ETL Appliance provides full metadata information with every running session (also useful for eventual process reengineering of ETL process) and full data overexposure protection.

Profil de marché

Alliances :

• Financier
• Ventes / marketing
• Technologie

Alliances stratégiques :

Data Integrity Institute Inc. specializes in the research and development of advanced technologies for Corporate Metadata Repository, massive ETL, and Data Integrity management.

Data Integrity Institute Inc. offers Copula ETL Appliance, a first Application Specific ETL Appliance. Copula ETL Appliance is a complete ETL solution, including most advanced hardware (with massive parallel multi core CPUs, fastest external and internal networking, parallel disk arrays), load balancing parallel operating environment, most efficient ETL engine, and custom build according user business specification, ETL solution.

Copula ETL Appliance is guaranteed to be implemented and delivered within 3 months after business specification is submitted, without any development on the user side. Copula ETL Appliance will execute specified ETL task within 3 hours. Copula ETL Appliance provides full metadata information with every running session (also useful for eventual process reengineering of ETL process) and full data overexposure protection.

Secteurs industriels d'intérêt :

• Agriculture
• Construction
• Produits de consommation
• Culture
• Affaires environnementales
• Pêche
• Industries forestières
• Technologies de l'information et télécommunications
• Fabrication et transformation
• Industries médicales, biotechnologiques et chimiques
• Mines, pétrole et gaz
• Industries de services
• Tourisme
• Transports
• Gros et détail
• Aérospatiale
• Défense
• Automobile
• Fabrication d'aliments de boissons
• Produits de meubles et en bois
• Pâtes et papiers
• Produits en caoutchouc et en plastique
• Première transformation des métaux et produits métalliques
• Appareils électriques
• Textiles et vêtements

Marchés géographiques :

Expérience en exportation :

• Allemagne
• États-Unis
• Californie
• New Jersey
• New York
• Virginie
• Wisconsin

Recherche active de marchés :

• Afrique du Sud
• Algérie
• Arabie saoudite
• Australie
• Autriche
• Belgique
• Brésil
• Brunei Darussalam
• Chili
• Chine
• Corée, République de
• Danemark
• Djibouti
• Égypte
• Émirats arabes unis
• Espagne
• France
• Grèce
• Hong-Kong
• Indonésie
• Iran, République Islamique d'
• Irlande
• Islande
• Israël
• Italie
• Japon
• Jordanie
• Kazakhstan
• Kirghizistan
• Koweït
• Liban
• Libyenne, Jamahiriya Arabe
• Liechtenstein
• Luxembourg
• Macao
• Malaisie
• Maroc
• Mexique
• Micronésie, États fédérés de
• Monaco
• Nouvelle-Zélande
• Oman
• Ouzbékistan
• Pakistan
• Pays-Bas
• Qatar
• Royaume-Uni
• Russie, Fédération de
• Saint-Marin
• Singapour
• Suisse
• Syrienne, République Arabe
• Tadjikistan
• Taiwan
• Tunisie
• Turkménistan
• Turquie
• Yémen
• Alabama
• Alaska
• Arizona
• Arkansas
• Caroline du Nord
• Caroline du Sud
• Colorado
• Connecticut
• Dakota du Nord
• Dakota du Sud
• Delaware
• District de Columbia
• Floride
• Georgie
• Hawaii
• Idaho
• Illinois
• Indiana
• Iowa
• Kansas
• Kentucky
• Louisiane
• Maine
• Maryland
• Massachusetts
• Michigan
• Minnesota
• Mississippi
• Missouri
• Montana
• Nebraska
• Nevada
• New Hampshire
• Nouveau-Mexique
• Ohio
• Oklahoma
• Oregon
• Pennsylvanie
• Rhode Island
• Tennessee
• Texas
• Utah
• Vermont
• Virginie-Occidentale
• Washington
• Wyoming

Renseignements sectoriels

Demande unique :

Data Integrity Institute Inc. offers Copula ETL Appliance, a first Application Specific ETL Appliance. Copula ETL Appliance is a complete ETL solution, including most advanced hardware (with massive parallel multi core CPUs, fastest external and internal networking, parallel disk arrays), load balancing parallel operating environment, most efficient ETL engine, and custom build according user business specification, ETL solution.
Copula ETL Appliance is guaranteed to be implemented and delivered within 3 months after business specification is submitted, without any development on the user side. Copula ETL Appliance will execute specified ETL task within 3 hours. Copula ETL Appliance provides full metadata information with every running session (also useful for eventual process reengineering of ETL process) and full data overexposure protection.

ETL solution for extremely large volume of data of 2500 million records using Ascential DataStage in an NCR Teradata and IBM DB2 environment.

Clients clés / principaux clients :

Bank of Canada, Ottawa, ON
Bank of America, Dallas, TX
Bruce Power, Tiverton, ON
RBC Royal Bank, Toronto, ON
Wisconsin State Department Of Transportation, Madison, WI
Philip Morris, Richmond, VA
Blockbuster, Dallas, TX
Banque Nationale, Montreal, PQ
Hoffmann - La Roche, Nutley, NJ
Enbridge, Consumers Gas, Toronto, ON
Amex, American Express, Markham, ON Canada
Amex, American Express, Brighton, ES United Kingdom
CIBC - Canadian Imperial Bank of Commerce, Toronto, ON
Gap, San Francisco, CA
Bell Canada, Toronto, ON
Bell Canada, Montreal, PQ
WCB Alberta, Edmonton, AB
Ministry of Health, Ontario
ISM - IBM Global Services, Toronto, ON
d.d. synergy GmbH, Hamburg, Germany
Glaxo Wellcome Inc., Mississauga, ON
IBM Canada Ltd., Toronto, ON
CGI, Toronto, ON
CGI, Montreal, PQ
Westbury Canadian Life, Hamilton, ON

Réussite :

Data Integrity Institute Inc. has developed and through research continues to systematically improve upon some of the most efficient sorting algorithm based on advanced nanotechnology research.

Today's major database and ETL engines use comparison based sorting algorithms derived from the well known quick sort, heap sort, merge sort, etc., algorithms. All of these comparison based algorithms operate on the item level, utilizing multiple active and passive comparisons per item.

Active comparison compares a selected item with other items by calling comparison functions customized to handle a comparison for a particular item type, which returns three possible outcomes: equal (0), greater than (+1), or less than (-1). The comparison process can be very slow because of the need to compare each item to other items multiple times and especially because of the customized comparison function call overhead.

Passive comparison checks each item several times for the position of that item in the memory array and/or in the file to ensure that that item is within its expected boundaries. This is done to eventually swap compared items and for many other purposes. The position of an item is represented by an integer, but it is still time consuming to perform the checks several times for each item.

Through its nanotechnology research initiative, Data Integrity Institute Inc. has developed the most efficient sorting algorithm that does not operate on the item level, but rather on the item sub level (nano level), and never performs either active or passive comparison of items. With such fine granulation there is no overhead making the sorting process fast and efficient.

Nanotechnology Sorting Statistics ( on a single workstation )

Nanotechnology Sorting sorts an array of 1 billion ( 1 000 000 000 ) double, 64 bit, floating point numbers (IEEE Standard 754), within one second on the single 4 core CPU with 24 GB RAM memory.

Workstation: Single

Motherboard: One

CPU: One

Cores per CPU: Four

RAM: 24 GB

Operating system: Either Microsoft Windows 64 bit or Linux 64 bit

Sorted data: Random generated array of 1 billion double, 64 bit, floating point numbers (IEEE Standard 754)

FPU used: No, all notechnology, sub item level access

Data types supported: Any

SQL data types supported: All SQL data types, including all types of Binary Large Objects (BLOB)

Most efficient data to sort: Integer

Linearity distortion (slowing) when sorted double, 64 bit, floating point numbers (IEEE Standard 754), data type, compared to 64 bit integer data type: Less than 0.01 (1%)

- Description: Sorting of an array of double, 64 bit, floating point numbers, will take no more than 1.01 of time of sorting of a same size array of 64 bit integers

Linearity distortion (slowing) when size of a sorted array is doubled: Less than 0.01 (1%)

- Description: Sorting of a twice size array of same data type will take no more than 2.01 of time

Nanotechnology Sorting ( hard drive operations )

When an array to be sorted exceeds the amount of available RAM so hard drive is used, Nanotechnology Sorting accesses a hard drive in following steps:

1. Sequential read of data

- Description: Data are read sequentially in very large blocks, depends of available RAM. Next block is taken next from previous, and so on.

2. Sequential write of data

- Description: Data are written sequentially in very large blocks, depends of available RAM. Next block is placed next to previous, and so on.

3. Random read of data

- Description: Data are read randomly, rather in large blocks (still not each item individually), depends of available RAM. Next block is taken according internal Nanotechnology Sorting algorithm logic.

4. Sequential write of data

- Description: Data are written sequentially in very large blocks, depends of available RAM. Next block is placed next to previous, and so on.

Number of hard drives support: Limited by operating system

Number of files support: Limited by operating system

Size of files support: Limited by operating system

Number of nodes support: Limited by operating system

Size of RAM support: Limited by operating system

Support for multiple operating systems for a single sorting session: Yes

Number of multiple operating systems for a single sorting session: No limit

Support for different operating systems for a single sorting session: Yes

Number of different operating systems for a single sorting session: No limit

Contact Data Integrity Institute Inc.

For further information on Data Integrity Institute Inc.'s research or how Data Integrity Institute Inc. can help you to implement, save or maintain an enterprise ETL or metadata project, please send a detailed inquiry to: info@DataIntegrityInstitute.com , or call (416) 282-2298

Témoignage :

http://www.b-eye-network.com/blogs/linstedt/archives/2007/02/bidw_appliances.php


http://www.dataintegrityinstitute.com/Enterprise_Metadata_System.htm
http://www.dataintegrityinstitute.com/Impact_Analysis.htm
http://www.dataintegrityinstitute.com/Data_Lineage.htm
http://www.b-eye-network.com/blogs/linstedt/archives/2007/05/where_o_where_i.php#more