1 Export Information
2 TallyEngine
3 Using XMLPipeDB match to Validate the XML Results from the TallyEngine
4 Using SQL Queries to Validate the PostgreSQL Database Results from the TallyEngine
5 OriginalRowCounts Comparison
6 Visual Inspection
7 .gdb Use in GenMAPP
8 Compare Gene Database to Outside Resource
9 Other Links

Export Information

Version of GenMAPP Builder:

Computer on which export was run: back row, second from door.

Postgres Database name:

UniProt XML filename (give filename and upload and link to compressed file):

UniProt XML version (The version information can be found at the UniProt News Page): UniProt release 2015_10
UniProt XML download link: http://www.uniprot.org/uniprot/?query=organism:243277
Time taken to import: 3.06 minutes
- Note:

GO OBO-XML filename (give filename and upload and link to compressed file):

GO OBO-XML version (The version information can be found in the file properties after the file downloaded from the [GO Download page] has been unzipped): 10/27/2015, 2:24am
GO OBO-XML download link: http://geneontology.org/page/download-ontology#Legacy_Downloads
Time taken to import: 7.58 minutes
Time taken to process: 4.37 minutes
- Note:

GOA filename (give filename and upload and link to compressed file):

GOA version (News on this page records past releases; current information can be found in the Last modified field on the FTP site): 10/13/15
GOA download link: http://ftp.ebi.ac.uk/pub/databases/GO/goa/proteomes/46.V_cholerae_ATCC_39315.goa
Time taken to import:
- Note:

Name of .gdb file (give filename and upload and link to compressed file):

Time taken to export: 0.06 minutes
- Start time: 10/27/2015, 3:52:08PM PDT
- End time: 10/27/2015, 5:09:55PM PDT

Note:

TallyEngine

I ran the TallyEngine in GenMAPP Builder and recorded the number of records for UniProt and GO in the XML data and in the Postgres databases.
- After running PostgreSQL and making sure my database was running, I ran GenMAPP builder and connected it to the database.
- After performing an import, I chose Run XML and Database Tallies for Uniprot and and selected the UniProt and GO files that I imported.
- My Tally results are in the screenshot below:
- The Tally results indicated counts for unique genes (labelled as Ordered Locus)
  - XML: 3831 unique genes
  - Database: 3831 unique genes

Using XMLPipeDB match to Validate the XML Results from the TallyEngine

In order to check the number of genes via xmlpipedb match, I used a command that utilized match for the file containing all of the uniprot genes.
Command Used:

   java -jar xmlpipedb-match-1.1.1.jar "VC_[0-9][0-9][0-9][0-9]" < uniprot-organism%3A243277.xml"

XMLPipeDB Match returned 2738 unique genes.
- This number is different than the numbers the TallyEngine returned.
- Upon later analysis (documented later in this lab notebook), I realized that the discrepancy between these counts is mostly attributed to the several different formats between which the genes are presented in the UniProt file. Despite all of these formats, we only counted the genes named in the format "VC_####" which disregards the other legitimate naming format. More details regarding these findings will be mentioned later.

Using SQL Queries to Validate the PostgreSQL Database Results from the TallyEngine

For more information, see this page.

You can also look for counts at the SQL level, using some variation of a select count(*) query. This requires some knowledge of which table received what data. Here’s an initial tip: the gene/name tags in the XML file land in the genenametype table. A query on this table counting values from this table that were marked as ordered locus in the XML file matching the pattern VC_[0-9][0-9][0-9][0-9] would look like this:

select count(*) from genenametype where type = 'ordered locus' and value ~ 'VC_[0-9][0-9][0-9][0-9]';

In pgAdmin III, you can issue these queries by clicking on the pencil/SQL icon in the toolbar, typing the query into the SQL Editor tab, then clicking on the green triangular Play button to run.

Are your results the same as reported by the TallyEngine? Why or why not?

OriginalRowCounts Comparison

Within the .gdb file, look at the OriginalRowCounts table to see if the database has the expected tables with the expected number of records. Compare the tables and records with a benchmark .gdb file.

Benchmark .gdb file:

Copy the OriginalRowCounts table from the benchmark and new gdb and paste them here:

Note:

Visual Inspection

Perform visual inspection of individual tables to see if there are any problems.

Look at the Systems table. Is there a date in the Date field for all gene ID systems present in the database?
Open the UniProt, RefSeq, and OrderedLocusNames tables. Scroll down through the table. Do all of the IDs look like they take the correct form for that type of ID?

Note:

.gdb Use in GenMAPP

Note:

Putting a gene on the MAPP using the GeneFinder window

Try a sample ID from each of the gene ID systems. Open the Backpage and see if all of the cross-referenced IDs that are supposed to be there are there.

Note:

Creating an Expression Dataset in the Expression Dataset Manager

How many of the IDs were imported out of the total IDs in the microarray dataset? How many exceptions were there? Look in the EX.txt file and look at the error codes for the records that were not imported into the Expression Dataset. Do these represent IDs that were present in the UniProt XML, but were somehow not imported? or were they not present in the UniProt XML?

Note:

Coloring a MAPP with expression data

Note:

Running MAPPFinder

Note:

Compare Gene Database to Outside Resource

The OrderedLocusNames IDs in the exported Gene Database are derived from the UniProt XML. It is a good idea to check your list of OrderedLocusNames IDs to see how complete it is using the original source of the data (the sequencing organization, the MOD, etc.) Because UniProt is a protein database, it does not reference any non-protein genome features such as genes that code for functional RNAs, centromeres, telomeres, etc.

Note:

Anuvarsh Week 9

Contents

Export Information

TallyEngine

Using XMLPipeDB match to Validate the XML Results from the TallyEngine

Using SQL Queries to Validate the PostgreSQL Database Results from the TallyEngine

OriginalRowCounts Comparison

Visual Inspection

.gdb Use in GenMAPP

Putting a gene on the MAPP using the GeneFinder window

Creating an Expression Dataset in the Expression Dataset Manager

Coloring a MAPP with expression data

Running MAPPFinder

Compare Gene Database to Outside Resource

Other Links

Assignment Pages

Individual Journals

Shared Journals

Navigation menu

Personal tools

Namespaces

Variants

Views

More

Search

Navigation

Tools