Jkuroda Week 8
From LMU BioDB 2015
Contents
Normalized the log ratios for the set of slides in the experiment
To scale and center the data (between chip normalization) I performed the following operations:
- Inserted a new Worksheet into my Excel file, and named it "scaled_centered".
- Went back to the "compiled_raw_data" worksheet, Selected All and Copy. Went to my new "scaled_centered" worksheet, clicked on the upper, left-hand cell (cell A1) and Pasted.
- Inserted two rows in between the top row of headers and the first data row.
- In cell A2, typed "Average" and in cell A3, typed "StdDev".
- I computed the Average log ratio for each chip (each column of data). In cell B2, I typed the following equation:
=AVERAGE(B4:B5224)
- and pressed "Enter". Excel computed the average value of the cells specified in the range given inside the parentheses. Instead of typing the cell designations, I clicked on the beginning cell, scrolled down to the bottom of the worksheet, and shift-clicked on the ending cell.
- I then computed the Standard Deviation of the log ratios on each chip (each column of data). In cell B3, I typed the following equation:
=STDEV(B4:B5224)
- and pressed "Enter".
- Excel then did some of the work for me. I copied these two equations (cells B2 and B3) and pasted them into the empty cells in the rest of the columns. Excel automatically changed the equation to match the cell designations for those columns.
- I have now computed the average and standard deviation of the log ratios for each chip. Now I actually did the scaling and centering based on these values.
- I copied the column headings for all of my data columns and pasted them to the right of the last data column so that I had a second set of headers above the blank columns of cells. I edited the names of the columns so that they read as: A1_scaled_centered, A2_scaled_centered, etc.
- In cell N4, I typed the following equation:
=(B4-B$2)/B$3
- In this case, I wanted the data in cell B4 to have the average subtracted from it (cell B2) and be divided by the standard deviation (cell B3). I used the dollar sign symbols in front of the "2" and "3" to tell Excel to always reference that row in the equation, even though I pasted it for the entire column of 5221 genes.
- I copied and pasted this equation into the entire column.
- I then copied and pasted the scaling and centering equation for each of the columns of data with the "_scaled_centered" column header.
Performed statistical analysis on the ratios
I performed this step on the scaled and centered data I produced in the previous step.
- Inserted a new worksheet and named it "statistics".
- Went back to the "scaling_centering" worksheet and copied the first column ("ID").
- Pasted the data into the first column of my "statistics" worksheet.
- Went back to the "scaling_centering" worksheet and coped the columns that were designated "_scaled_centered".
- Went to my new worksheet and clicked on the B1 cell. Selected "Paste Special" from the Edit menu. A window opened: clicked on the button for "Values" and clicked OK. This pasted the numerical result into my new worksheet instead of the equation which must make calculations on the fly.
- Deleted Rows 2 and 3 where it said "Average" and "StDev" so that my data rows with gene IDs were immediately below the header row 1.
- Went to a new column on the right of my worksheet. Typed the header "Avg_LogFC_A", "Avg_LogFC_B", and "Avg_LogFC_C" into the top cell of the next three columns.
- Computed the average log fold change for the replicates for each patient by typing the equation:
=AVERAGE(B2:E2) into cell N2. Copied this equation and pasted it into the rest of the column.
- Created the equation for patients B and C and pasted it into their respective columns.
- Then I computed the average of the averages. Typed the header "Avg_LogFC_all" into the first cell in the next empty column. Created the equation that will compute the average of the three previous averages I calculated and pasted it into this entire column.
- Inserted a new column next to the "Avg_LogFC_all" column that I computed in the previous step. Labeled the column "Tstat". This computed a T statistic that told me whether the scaled and centered average log ratio was significantly different than 0 (no change). Entered the equation:
=AVERAGE(N2:P2)/(STDEV(N2:P2)/SQRT(3))
Copied the equation and pasted it into all rows in that column.
- Labeled the top cell in the next column "Pvalue". In the cell below the label, entered the equation:
=TDIST(ABS(R2),2,2)
Copied the equation and pasted it into all rows in that column.
Calculated the Bonferroni p value Correction
- Next I performed adjustments to the p value to correct for the multiple testing problem. Labeled the next two columns to the right with the same label, Bonferroni_Pvalue.
- Typed the equation
=S2*5221
, Upon completion of this single computation, used the trick to copy the formula throughout the column. - Replaced all corrected p values that were greater than 1 by the number 1 by typing the following formula into the first cell below the second Bonferroni_Pvalue header:
=IF(T2>1,1,T2)
. Used the trick to copy the formula throughout the column.
Calculated the Benjamini & Hochberg p value Correction
- Inserted a new worksheet named "B-H_Pvalue".
- Copied and pasted the "ID" column from my previous worksheet into the first column of the new worksheet.
- Inserted a new column on the very left and named it "MasterIndex". I created a numerical index of genes so that I can always sort them back into the same order.
- Typed a "1" in cell A2 and a "2" in cell A3.
- Selected both cells and filled the entire column with a series of numbers from 1 to 5221.
- Copied my unadjusted p values from my previous worksheet and pasted it into Column C.
- Selected all of columns A, B, and C. Sorted by ascending values on Column C. Clicked the sort button from A to Z on the toolbar and sorted by column C, smallest to largest.
- Typed the header "Rank" in cell D1. I created a series of numbers in ascending order from 1 to 5221 in this column. Typed "1" into cell D2 and "2" into cell D3. Selected both cells D2 and D3 and filled the column with a series of numbers from 1 to 5221.
- Then I calculated the Benjamini and Hochberg p value correction by typing B-H_Pvalue in cell E1. Typed the following formula in cell E2:
=(C2*5221)/D2
and pressed enter. Copied that equation to the entire column. - Typed "B-H_Pvalue" into cell F1.
- Typed the following formula into cell F2:
=IF(E2>1,1,E2)
and pressed enter. Copied that equation to the entire column. - Selected columns A through F. Then I sorted them by my MasterIndex in Column A in ascending order.
- Copied column F and pasted it into the next column on the right of my "statistics" sheet.
Prepared file for GenMAPP
- Inserted a new worksheet and named it "forGenMAPP".
- Went back to the "statistics" worksheet and Selected All and Copied.
- Went to my new sheet and clicked on cell A1 and selected Paste Special, clicked on the Values button, and clicked OK. I then formated this worksheet for import into GenMAPP and:
- Selected Columns B through Q (all the fold changes). Selected the menu item Format > Cells. Under the number tab, selected 2 decimal places. Clicked OK.
- Selected all the columns containing p values. Selected the menu item Format > Cells. Under the number tab, selected 4 decimal places. Clicked OK.
- Deleted the left-most Bonferroni p value column, thus preserving the one that shows the result of my "if" statement.
- Inserted a column to the right of the "ID" column. Typed the header "SystemCode" into the top cell of this column. Filled the entire column with the letter "N".
- Selected the menu item File > Save As, and chose "Text (Tab-delimited) (*.txt)" from the file type drop-down menu. My new *.txt file is now ready for import into GenMAPP.
- Uploaded both the .xls and .txt files that you have just created to my journal page in the class wiki.
GenMAPP Expression Dataset Manager Procedure
- Launched the GenMAPP Program. Checked to make sure the correct Gene Database is loaded.
- Looked in the lower, left-hand corner of the main GenMAPP Drafting Board window to see the name of the Gene Database that was loaded.
- I used the 2010 version.
- Selected the Data menu from the main Drafting Board window and chose Expression Dataset Manager from the drop-down list. The Expression Dataset Manager window opened.
- Selected New Dataset from the Expression Datasets menu. Selected the tab-delimited text file that I formatted for GenMAPP (.txt) in the procedure above from the file dialog box that appears.
- The Vibrio data I have been working with does not have any text (character) data in it.
- Allowed the Expression Dataset Manager to convert your data.
- When the process is complete, the converted dataset was active in the Expression Dataset Manager window and the file was saved in the same folder the raw data file was in, named the same except with a .gex extension.
- Lines that generated an error during the conversion of a raw data file were not added to the Expression Dataset. Instead, an exception file was created. The exception file was given the same name as my raw data file with .EX before the extension. The exception file contains all of my raw data, with the addition of a column named ~Error~. This column contains either error messages or, if the program finds no errors, a single space character.
- Recorded the number of errors, in my case, 121 errors. For my journal assignment, I opened the .EX.txt file and used the Data > Filter > Autofilter function to determine what the errors were for the rows that were not converted:
Errors go here!!!!
- I got a different number of errors than my partner, who is using a different version of the Vibrio cholerae Gene Database. He got 772 errors while I got 121 errors.
Why do you think that is?
- I would think that this is the case because of the fact that I used the more recent, 2010 version, while he used the 2009 version, which would have been less extensive and apparently had less data.
- Uploaded my exceptions file:
EX.txt
to my wiki page.
- Uploaded my exceptions file:
- Customized the new Expression Dataset by creating new Color Sets which contain the instructions to GenMAPP for displaying data on MAPPs.
- Created a Color Set by filling in the following different fields in the Color Set area of the Expression Dataset Manager: a name for the Color Set, the gene value, and the criteria that determine how a gene object is colored on the MAPP. Entered a name in the Color Set Name field, i.e. LogFoldChange.
- The Gene Value was the data displayed next to the gene box on a MAPP. Selected the column of data to be used as the Gene Value from the drop down list or select [none]. I used "Avg_LogFC_all" for the Vibrio dataset I just created.
- Activated the Criteria Builder by clicking the New button.
- Entered a name for the criterion in the Label in Legend field.
- Chose a color for the criterion by left-clicking on the Color box. Chose a color from the Color window that appears and clicked OK.
- Stated the criterion for color-coding a gene in the Criterion field.
- A criterion is stated with relationships such as "this column greater than this value" or "that column less than or equal to that value". Individual relationships can be combined using as many ANDs and ORs as needed. A typical relationship is
[ColumnName] RelationalOperator Value
- with the column name always enclosed in brackets and character values enclosed in single quotes. For example:
[Fold Change] >= 2 [p value] < 0.05 [Quality] = 'high'
- This is the equivalent to queries that I performed on the command line when working with the PostgreSQL movie database. GenMAPP is using a graphical user interface (GUI) to help the user format the queries correctly. The easiest and safest way to create criteria is by choosing items from the Columns and Ops (operators) lists shown in the Criteria Builder. The Columns list contains all of the column headings from your Expression Dataset. To choose a column from the list, I clicked on the column heading. It appeared at the location of the cursor in the Criterion box. The Criteria Builder surrounded the column names with brackets.
- The Ops (operators) list contains the relational operators that may be used in the criteria: equals ( = ) greater than ( > ), less than ( < ), greater than or equal to ( >= ), less than or equal to ( <= ), is not equal to ( <> ). To choose an operator from the list, click on the symbol. It will appear at the location of the insertion bar (cursor) in the Criterion box. The Criteria Builder automatically surrounds the operators with spaces.
- The Ops list also contains the conjunctions AND and OR, which may be used to make compound criteria. For example:
[Fold Change] > 1.2 AND [p value] <= 0.05
- Parentheses control the order of evaluation. Anything in parentheses is evaluated first. Parentheses may be nested. For example:
[Control Average] = 100 AND ([Exp1 Average] > 100 OR [Exp2 Average] > 100)
- Column names may be used anywhere a value can, for example:
[Control Average] < [Experiment Average]
- After completing a new criterion, I added the criterion entry (label, criterion, and color) to the Criteria List by clicking the Add button.
- For the Vibrio dataset, I created two criterion. "Increased" is [Avg_LogFC_all] > 0.25 AND [Pvalue] < 0.05 and "Decreased will be [Avg_LogFC_all] < -0.25 AND [Pvalue] < 0.05.
- The buttons to the right of the list represent actions that can be performed on individual criteria. To modify a criterion label, color, or the criterion itself, I first selected the criterion in the list by left-clicking on it, and clicked the Edit button. This puts the selected criterion into the Criteria Builder to be modified. Clicked the Save button to save changes to the modified criterion; clicked the Add button to add it to the list as a separate criterion. To remove a criterion from the list, I left-clicked on the criterion to select it, and clicked on the Delete button. The order of Criteria in the list has significance to GenMAPP. When applying an Expression Dataset and Color Set to a MAPP, GenMAPP examines the expression data for a particular gene object and applies the color for the first criterion in the list that is true. Therefore, it is imperative that when criteria overlap the user put the most important or least inclusive criteria in the list first. To change the order of the criteria in the list, I left-clicked on the criterion to select it and clicked the Move Up or Move Down buttons. No criteria met and Not found are always the last two positions in the list.
- For the Vibrio dataset, I created two criterion. "Increased" is [Avg_LogFC_all] > 0.25 AND [Pvalue] < 0.05 and "Decreased will be [Avg_LogFC_all] < -0.25 AND [Pvalue] < 0.05.
- Saved the entire Expression Dataset by selecting Save from the Expression Dataset menu. Changes made to a Color Set are not saved until I do this.
- Exited the Expression Dataset Manager to view the Color Sets on a MAPP. Chose Exit from the Expression Dataset menu.
- Uploaded my .gex file to your journal entry page for later retrieval.
MAPPFinder Procedure
- Launched the MAPPFinder program.
- Made sure that the Gene Database for the correct species was loaded. The name of the Gene Database appeared at the bottom of the window.
- Clicked on the button "Calculate New Results".
- Clicked on "Find File" and chose the my Expression Dataset file, and clicked OK.
- Chose the Color Set and Criteria with which to filter the data. Clicked on the "Increased" criteria in the right-hand box.
- Checked the boxes next to "Gene Ontology" and "p value".
- Clicked the "Browse" button and created a meaningful filename for myresults.
- Clicked "Run MAPPFinder". The analysis took several minutes.
- When the results have been calculated, a Gene Ontology browser opened showing myresults. All of the Gene Ontology terms that have at least 3 genes measured and a p value of less than 0.05 were highlighted yellow. A term with a p value less than 0.05 is considered a "significant" result. Browsed through the tree to see myresults.
- To see a list of the most significant Gene Ontology terms, I clicked on the menu item "Show Ranked List".
- List the top 10 Gene Ontology terms in your individual journal entry.
- branched chain family amino acid metabolic process
- branched chain family amino acid biosynthetic process
- IMP metabolic process
- IMP biosynthetic process
- purine ribonucleoside monophosphate metabolic process
- purine ribonucleoside monophosphate biosynthetic process
- purine nucleoside monophosphate biosynthetic process
- purine nucleoside monophosphate metabolic process
- 'de novo' IMP biosynthetic process
- arginine metabolic process
- Compare your list with your partner who used a different version of the Gene Database. Are your terms the same or different? Why do you think that is? Record your answer in your individual journal entry.
- Our terms ended up looking differently from one another, and I believe this is because of the growth of the data over the year between 2009 and 2010 and possibly due to the growth of gene ontology itself.
- One of the things you can do in MAPPFinder is to find the Gene Ontology term(s) with which a particular gene is associated. First, in the main MAPPFinder Browser window, I clicked on the button "Collapse the Tree". Then I searched for the genes that were mentioned by Merrell et al. (2002), VC0028, VC0941, VC0869, VC0051, VC0647, VC0468, VC2350, and VCA0583. Typed the identifier for one of these genes into the MAPPFinder browser gene ID search field. Chose "OrderedLocusNames" from the drop-down menu to the right of the search field. Clicked on the GeneID Search button. The GO term(s) that are associated with that gene will be highlighted in blue. List the GO terms associated with each of those genes in your individual journal. (Note: they might not all be found.) Are they the same as your partner who is using a different Gene Database? Why or why not?
- VC0028: BRANCHED CHAIN FAMILY AMINO ACID BIOSYNTHETIC PROCESS, CELLULAR AMINO ACID BIOSYNTHETIC PROCESS, METABOLIC PROCESS, METAL ION BINDING, IRON-SULFUR CLUSTER BINDING, 4 IRON, 4 SULFUR CLUSTER BINDING, CATALYTIC ACTIVITY, LYASE ACTIVITY, DIHYDROXY-ACID DEHYDRATASE ACTIVITY
- VC0491: NONE
- VC0869: GLUTAMINE METABOLIC PROCESS, PURINE NUCLEOTIDE BIOSYNTHETIC PROCESS, 'DE NOVO' IMP BIOSYNTHETIC PROCESS, CYTOPLASM, NUCLEOTIDE BINDING, ATP BINDING, CATALYTIC ACTIVITY, LIGASE ACTIVITY, PHOSPHORIBOSYLFORMYLGLYCINAMIDINE SYNTHASE ACTIVITY
- VC0051: PURINE NUCLEOTIDE BIOSYNTHETIC PROCESS, 'DE NOVO' IMP BIOSYNTHETIC PROCESS, NUCLEOTIDE BINDING, ATP BINDING, CATALYTIC BINDING, LYASE ACTIVITY, CARBOXY-LYASE ACTIVITY, PHOSPHORIBOSYLAMINOIMIDAZOLE CARBOXYLASE ACTIVITY
- VC0647: MRNA CATABOLIC PROCESS, RNA PROCESSING, CYTOPLASM, MITOCHONDRION, RNA BINDING, 3'-5' EXORIBONUCLEASE ACTIVITY, TRANSFERASE ACTIVITY, NUCLEOTIDYLTRANSFERASE ACTIVITY, POLYRIBONUCLEOTIDE NUCLEOTIDYLTRANSFERASE ACTIVITY
- VC0468: GLUTHATHIONE BIOSYNTHETIC PROCESS, METAL ION BINDING, NUCLEOTIDE BINDING, ATP BINDNIG, CATALYTIC ACTIVITY, LIGASE ACTIVITY, GLUTHATHIONE SYNTHASE ACTIVITY
- VC2350: DEOXYRIBONUCLEOTIDE CATABOLIC PROCESS, METABOLIC PROCESS, CYTOPLASM, CATALYTIC ACTIVITY, DEOXYRIBOSE-PHOSPHATE ALDOLASE ACTIVITY
- VCA0583: TRANSPORT, OUTER MEMBRANE-BOUNDED PERIPLASMIC SPACE, TRANSPORTER ACTIVITY
- They are not the same as my partner, probably because of the fact that he is using the older version of the gene database, and therefore has less genes with which a GO term can be associated.
- Click on one of the GO terms that are associated with one of the genes you looked up in the previous step. A MAPP will open listing all of the genes (as boxes) associated with that GO term. The genes named within the map are based on the UniProt identification system. To match the gene of interest to its identification go to the UniProt site and type in your gene ID into the search bar. Moreover, the genes on the MAPP will be color-coded with the gene expression data from the microarray experiment. List in your journal entry the name of the GO term you clicked on and whether the expression of the gene you were looking for changed significantly in the experiment.
I clicked on the transporter activity GO term. I looked for Q9KM06 and its color was gray, which meant no criteria were met.
- Double-click on the gene box. This will open a Internet Explorer window called the "Backpage" for this gene. This page has links to pages for this gene in the public databases. Click on the links to find out the function of this gene and record your answer in your individual journal page.
According to the NCBI, the gene is for protein coding a hypothetical protein.
- The MAPP that has just been created is stored in the directory, C:\GenMAPP 2 Data\MAPPs\VC GO. Upload this file and link to it in your journal.
- In Windows, make a copy of your results (XXX-CriterionX-GO.txt) file.
- "XXX" refers to the name you gave to your results file.
- "CriterionX" refers to either "Criterion0" or "Criterion1". Since computers start counting at zero, "Criterion0" is the first criterion in the list you clicked on ("Increased" if you followed the directions) and "Criterion1" is the second criterion in the list you clicked on ("Decreased" if you followed the directions).
- Upload your results file to your journal page.
- Launch Microsoft Excel. Open the copies of the .txt files in Excel (you will need to "Show all files" and click "Finish" to the wizard that will open your file). This will show you the same data that you saw in the MAPPFinder Browser, but in tabular form.
- Look at the top of the spreadsheet. There are rows of information that give you the background information on how MAPPFinder made the calculations. Compare this information with your partner who used a different version of the Vibrio Gene Database. Which numbers are different? Why are they different? Record this information in your individual journal entry.
- You will filter this list to show the top GO terms represented in your data for both the "Increased" and "Decreased" criteria. You will need to filter your list down to about 20 terms. Click on a cell in the row of headers for the data. Then go to the Data menu and click "Filter > Autofilter". Drop-down arrows will appear in the row of headers. You can now choose to filter the data. Click on the drop-down arrow for the column you wish to filter and choose "(Custom…)". A window will open giving you choices on how you want to filter. You must set these two filters:
Z Score (in column N) greater than 2 PermuteP (in column O) less than 0.05
- You will use these two filters depending on the number of terms you have:
Number Changed (in column I) greater than or equal to 4 or 5 AND less than 100 Percent Changed (in column L) greater than or equal to 25-50%
- Save your changes to an Excel spreadsheet. Select File > Save As and select Excel workbook (.xls) from the drop-down menu. Your filter settings won’t be saved in a .txt file.
- Are any of your filtered GO terms closely related to one another, meaning are they a direct child or parent to another term in the list? You can judge this by comparing your spreadsheet with the MAPPFinder browser. Highlight the terms that fit this relationship with the same color in your Excel spreadsheet. Upload your .xls file to your journal page.
- Interpret your results. Look up the definitions for any GO terms that are unfamiliar to you. The "official" definitions for GO terms can be found at http://www.geneontology.org. You can use one of the online biological dictionaries as a supplement, if needed. Write a paragraph relating the results of this GO analysis to the experiment performed (comparing laboratory-grown and patient-derived Vibrio cholerae. You need to give a biological interpretation of what do each of these GO terms in your filtered list have to to with the pathogenecity of the bacterium? You may consult with your partner on this, but your explanation on your individual journal page needs to be in your own words. This is where the real "brain power" comes in with interpreting DNA microarray data. Even experienced scientists struggle with this part. Use your creativity as a scientist to stretch your brain in this question.
- There is one other file you need to save to your journal page. It has a .gmf extension and should be in the same fold as the .gex file that you created with the GenMAPP Expression Dataset Manager. You will need this file to re-open your results in MAPPFinder.
Conclusion
- Write a paragraph that briefly summarizes and gives a scientific conclusion for the work that you did for part 1 and 2 this week.
Individual Journal Entries
- Week 2
- Week 3
- Week 4
- Week 5
- Week 6
- Week 7
- Week 8
- Week 9
- Week 10
- Week 11
- Week 12
- Week 13
- Week 14
- Week 15