Download EMBOSS user's guide : practical bioinformatics
Transcript
EMBOSS User's Gu Mr Peter Rice EMBL European Bioinformatics Dr Alan Institute Bleasby EMBL European Bioinformatics Institute Dr Jon EMBL Ison European Bioinformatics Institute with contributions from Lisa Mullan Guy Bottu CAMBRIDGE UNIVERSITY PRESS Contents Acknowledgements Preface page XVI XIX Conventions XXII Welcome to the EMBOSS User's Guide Summary Chapter 1. Chapter 2. Chapter 3. Chapter 4. xxv XXV Background to EMBOSS XXV Basic setup and maintenance Getting started Tutorial XXV XXV XXV Chapter 5. File formats Chapter 6. The EMBOSS command line Chapter Chapter 7. Interfaces XXV XXVI XXVI 8. Using EMBOSS under wEMBOSS XXVI Chapter 9. Using EMBOSS under Jemboss xxvi Appendix A. File format reference XXVI Appendix B. Application reference XXVII Appendix C. Command-line qualifier reference XXVII Appendix D. Resources XXVH 1 Background 1.1 History 1.2 EMBOSS 1.3 Key features to EMBOSS developers General features 1.3.2 Features for 2.1 2.2 2.3 2 3 1.3.1 2 3 users of EMBOSS Basic setup and maintenance Supported platforms 7 Hardware requirements 8 Software requirements 8 2.3.1 GNU tools 2.3.2 EMBOSS dependencies 2.3.3 EMBASSY 2.4 2.4.1 2.4.2 i I 5 7 8 dependencies Software releases 9 Stable releases 9 8 8 2.5.2 Developer's (CVS) release 11 Downloading the stable release 11 Downloading via the EMBOSS website Downloading via anonymous FTP 12 2.6 Package 2.5 2.5.1 structure 11 14 V CONTENTS Major components Sub-components 2.6.1 2.6.2 Differences between CVS and stable versions 2.6.3 2.7 14 14 Installation 2.7.1 Overview of the installation process 2.7.2 2.7.4 Configuration 16 Compilation 17 Setting your PATH 2.7.5 Testing 2.7.6 Database setup 2.7.7 Installing EMBASSY packages 2.7.3 2.8 15 16 all is well Maintenance 16 18 18 19 20 22 2.8.2 Using CVS to update 22 Bug-fix replacement files 23 2.8.3 Patch files 2.8.4 Automated installation of EMBOSS and EMBASSY 2.8.5 Automated database 2.8.1 24 started 3 Getting 3.1 Application documentation 28 3.1.1 Online documentation 3.1.2 AJAX 3.1.3 Interfaces 3.2 26 updating 28 28 command definition (ACD) language 29 29 3.2.2 Navigating the application documentation 29 Navigating the tabular documentation 29 Sections in the application documentation 29 3.3 How to contribute 3.2.1 30 EMBOSS coordination meetings Collaborations 31 3.3.1 3.3.2 3.4 3.4.1 3.4.2 3.4.3 Project mailing lists 31 User mailing list 31 Developer mailing list 32 Announcements mailing list 3.4.4 3.5 Mail archives How to get help 33 EMBOSS documentation 3.5.2 EMBOSS 3.5.4 3.6 3.6.1 33 frequently asked questions 33 Asking for help 33 Suggesting new features and applications Reporting bugs and problems 35 Where to send a bug report 35 3.6.2 Before you send a bug report 35 How to write a bug report 35 3.6.3 3.7 32 32 3.5.1 3.5.3 31 EMBOSS training 3.7.1 EMBOSS tutorial 3.7.2 EMBOSS 3.7.3 EMBOSS VI 35 36 developer's course workshops 36 36 34 25 CONTENTS tutorial 4 EMBOSS 4.1 How this tutorial is 4.2 wossname: a 4.2.1 4.3 4.4 4.4.1 4.5 4.5.1 4.6 user Exercise: 37 organised first EMBOSS 37 application Working with sequences 38 Retrieving sequences from databases Exercise: showdb seqret 40 Exercise: seqret 40 4.9 4.10 Listfiles 4.11 Pairwise sequence alignment 4.12 Dotplots 4.8 39 39 Reading sequences from files infoseq 41 Sequence annotation 42 Using multiple sequences 44 4.7 41 44 46 4.12.1 47 Exercise: making 4.12.2 Exercise: examining dotplot parameters 4.13 4.13.1 4.14 4.14.1 Global alignment Exercise: 4.16 Identifying 4.16.1 4.16.2 Exercise: partial USA for Secondary 4.20 pepinfo 4.21 4.21.1 4.22 4.23 4.23.1 4.24 4.25 4.25.1 4.26 4.26.1 4.26.2 4.26.3 4.27 49 50 52 54 sequences structure 52 54 sequence Exercise: transeq 4.19 48 50 reading frame (ORF) plotorf 52 getorf 52 Translating the 4.18 47 the open Exercise: 4.20.1 dotplot 48 water Protein analysis 4.17.1 a Exercise: needle Local alignment 4.15 4.17 37 37 wossname 55 prediction 55 56 Exercise: pepinfo 56 Predicting transmembrane regions 56 Exercise: tmap 56 Patterns, profiles and multiple sequence alignment Pattern matching 59 Exercise: patmatmotifs 59 Report formats 60 61 Protein fingerprints Exercise: paean 61 Multiple sequence analysis Exercise: retrieving a set Exercise: emma 63 62 of sequences Exercise: prettyplot Profiles 58 63 66 67 4.27.1 Exercise: prophecy 4.27.2 Exercise: prophet 68 69 VII CONTENTS 4.28 4.28.1 Conclusion 69 Exercise: tfm 69 5 File formats 70 5.1 Introduction to file formats 5.2 Introduction to sequence formats 5.2.1 What is 5.2.2 Supported a 70 sequence format? 71 71 5.2.4 sequence formats 72 Contents of a sequence entry 76 Specifying sequences on the command line 5.2.5 Applications 5.2.3 5.3 Introduction to feature formats 5.3.1 What is 5.3.2 Supported 5.3.3 How are features stored ? 5.3.4 Applications for 5.3.5 5.4 a feature? 82 feature formats 82 83 features 84 Specifying features on the command line to alignment formats 84 What is format? 85 Supported alignment formats 86 5.4.3 Contents of 5.5 5.5.1 an alignment alignment file 87 Specifying alignments on the command line Applications for sequence alignment 89 an Supported 5.5.3 Inside 5.5.4 Specifying a report formats report 91 92 reports Applications that on use the command line reports The EMBOSS command line 6.1 6.1.1 Introduction to 94 94 96 the EMBOSS command line 6.1.2 running EMBOSS applications Application options 96 6.1.3 Command line styles 6.1.4 Environment variables 6.2 6.2.1 6.2.2 6.2.3 6.2.4 6.2.5 6.2.6 6.3 Finding and 96 102 Specifying values for application options General rules 96 102 102 102 Simple ACD datatypes 103 Input ACD datatypes 106 Output ACD datatypes ill Selection ACD datatypes 114 Graphics ACD datatypes 116 116 Global command line qualifiers 116 6.3.1 Introduction 6.3.2 Description of global qualifiers 117 Global qualifiers and environment variables 6.3.3 88 Introduction to report formats 91 What is a report format? 91 5.5.2 .5.5 84 Introduction 5.4.2 5.4.5 81 82 5.4.1 5.4.4 80 for basic sequence manipulation VIII 121 CONTENTS 6.4 Datatype-specific command line qualifiers 6.4.1 Introduction 6.4.2 6.4.5 Sequences 123 Sequence features 132 Sequence alignments 137 General input 139 6.4.6 Patterns 6.4.7 General output 6.4.3 6.4.4 6.4.8 6.5 6.5.1 6.6 139 140 Application report output 141 Graphical output 142 Description of qualifiers 142 The Uniform Sequence Address (USA) 6.6.1 Introduction 6.6.2 USA syntax 6.6.3 Specifying the format 146 Specifying a database 147 Specifying a sequence file 149 Specifying a listfile 151 6.6.4 6.6.5 6.6.6 144 Specifying 6.6.8 6.6.9 Applications 152 Specifying search fields 6.6.10 USA summary a sequence'as is1 The Uniform Feature 7 Interfaces 7.1 Introduction 7.2 Command line interfaces 7.3 Types 7.4 Web interfaces 160 7.4.3 EMBOSS Explorer 7.4.4 W2H 7.4.5 SRSWWW 7.5.4 162 162 162 162 163 BioNavigator 163 Spinet 163 Graphical user interfaces (GUIs) Jemboss 164 Staden 165 CoLiMate 165 165 Kaptain 7.5.5 kemboss 7.5.6 Geneious 7.6 161 161 WebLab 7.5.3 160 of EMBOSS interfaces wEMBOSS 7.5.2 159 160 7.4.2 7.5.1 153 Object (UFO) 7.4.1 7.5 152 157 6.7 7.4.7 143 143 6.6.7 7.4.6 123 123 163 165 166 Workflow interfaces 7.6.1 Taverna 7.6.2 metalife 7.6.3 Pipeline Pilot 166 167 167 167 IX CONTENTS 7.6.4 BioWBI and WsBAW 7.6.5 G-Pipe Mobyle 7.6.6 7.7 168 Other interfaces 168 7.8 169 169 MolTalk 169 Selecting an interface 8 Using EMBOSS under 8.1 Introduction 8.2 Managing projects and files Project management 172 Running programs 172 Programs 175 7.7.1 7.7.2 7.7.3 8.3 8.3.1 8.4 167 168 Utopia emnu Handling 8.4.1 169 wEMBOSS 170 170 input and output 8.5 Plug-ins and applets 8.6 Bugs 8.7 wEMBOSS tutorial and fixes 171 175 177 178 178 Exercise: Starting up wEMBOSS, creating 8.7.1 program a 'project', running a 179 8.7.2 Exercise: Accessing 'public' databanks, using the sequence selectors, 8.7.3 managing graphical output 179 Exercise: Running a program on multiple sequences, using the output 180 program as input of another, using plug-ins and applets 9.1 Using EMBOSS under Jemboss Diving in at the deep end 183 9.2 Getting 9 started 183 185 requirements 9.2.1 Software 9.2.2 Microsoft desktop 9.2.3 9.2.4 Apple Macintosh UNIX platform 9.2.5 Local installation 9.2.6 Remote installation 185 186 186 186 186 9.2.10 187 Jemboss session 187 Session-specific information 187 The Jemboss windows 187 Settings 188 9.2.11 Proxies 9.2.12 Servers 9.2.7 9.2.8 9.2.9 9.3 9.3.1 189 189 File management 189 Local file management 189 9.3.2 Home directory 9.3.3 Working directory 190 Move up a directory 190 Creating data files in Jemboss 9.3.4 9.3.5 X 189 190 of one CONTENTS manipulation 9.3.6 File 9.3.7 New folder creation 9.3.8 Re-locating files 9.3.9 Rename 9.3.10 Delete 9.3.11 De-select all 9.3.12 Refresh 9.3.13 Open with 9.3.14 Remote file management 9.3.15 EMBOSS results 9.3.16 9.4 Moving 191 191 192 192 192 192 193 193 data between file managers Data analysis Program selection 194 Program categories 194 9.4.3 Favourites 194 9.4.4 Alphabetical program list 9.4.5 Go To box 9.4.6 9.4.8 Input section 195 File input 195 Input sequence options 9.4.9 Databases available 9.4.10 9.4.11 Sequence format Begin/end 197 9.4.12 Reverse complement 9.4.13 9.4.14 Nucleotide/protein 197 Upper/lower-case 197 9.4.15 UFO features 9.4.16 Load sequence attributes 9.4.17 Parameter selection 9.4.18 9.4.20 Output section 198 Output sequence options Sequence format 199 9.4.21 Filename extension 9.4.22 Base filename 9.4.23 Features format 9.4.24 Features filename 9.4.25 Sequence format 9.4.26 9.4.29 Graphical format 200 200 PNG graphics Jemboss graphics 200 Graph options 201 9.4.30 Main title 9.4.31 Axis number format 9.4.32 Ticks 9.4.33 Axis labels 9.4.34 Graph formatting 9.4.35 Saving Jemboss graphics 9.4.7 9.4.19 9.4.27 9.4.28 194 194 9.4.2 9.4.1 193 193 195 195 196 197 197 197 197 198 198 199 199 199 199 200 200 201 201 201 201 201 202 XI CONTENTS 9.4.36 Advanced parameter selection 9.4.37 Program 9.4.38 Interactive mode 9.4.39 Batch mode 9.5 run options 202 202 202 202 Saving results 203 Saving locally 9.5.1 9.5.2 203 Saved results: interactive mode 9.5.3 Saved results: batch mode 9.5.4 9.5.5 Saving remotely 204 Analysis run autosave 9.5.6 Local autosave Results retrieval 205 205 Remote autosave 9.5.7 9.6 205 206 9.6.3 Retrieving interactive results Retrieving batch results 206 Job Manager 206 9.6.4 Current Sessions Results 9.6.5 Display 9.6.6 Delete results 9.6.7 Refresh icon 9.6.1 9.6.2 9.7 results Retrieving 9.6.8 206 206 207 207 207 saved results Customisation 208 211 9.7.1 Directory location 211 9.7.2 Program selection 212 9.7.3 Input/output options 212 Job Manager update frequency Calculate dependencies 214 Proxy and server settings 214 9.7.4 9.7.5 9.7.6 9.8 Utilities 203 204 214 214 9.8.1 Jemboss Alignment Editor QAE) \8.2 DNA Editor t.8.3 J.9 JALVTEW 223 Documentation 223 9.9.1 Jemboss user guide 9.9.2 Application documentation 9.9.3 Version number 9.9.4 9.10 Appendix 214 220 Tooltips 224 Troubleshooting A A.l 224 226 sequence formats A.l.l ABI trace A.1.2 ACEDB A. 1.3 ASN1 A. 1.4 Asis A.1.5 Clustal A.l.6 CODATA 223 224 File format reference Supported XII 223 226 226 227 228 228 228 226 CONTENTS A. 1.7 DAS A. 1.8 DASDNA A. 1.9 Debug 230 A.1.10 EMBL 231 A.l.ll Experiment (Staden) A.1.12 FASTA 234 A.1.13 FASTA (GCG) A.1.14 FASTA (Pearson) 229 230 233 234 A.1.15 235 FASTA (with accession) A.1.16 FASTA (database and identifier) A.1.17 FASTA (GI style) 235 A. 1.24 236 FASTA (NCBIstyle) 236 Fastq 237 Fastq (Illumina) 237 Fastq (Sanger) 237 Fastq (Solexa) 238 Fitch 238 GCG 8, GCG 9.x and 10.x 238 A.1.25 GenBank 239 A. 1.26 GenPept 241 A.1.18 A.1.19 A. 1.20 A.1.21 A. 1.22 A.1.23 A. 1.27 GFF3 242 A.1.28 GFF2 243 A. 1.29 A. 1.32 Hennig86 243 Intelligenetics 244 Jackknifer 244 Jackknifer (non-interleaved) A.1.33 MASE A. 1.34 MEGA A.1.35 MEGA A.1.36 MSF A. 1.30 A.1.31 A.1.37 245 245 246 (non-interleaved) 246 247 NBRF/PIR A. 1.39 248 (interleaved) 248 NEXUS/PAUP (non-interleaved) A. 1.40 PDB A.1.41 PDB A. 1.42 Pfam/Stockholm A. 1.43 PHYLIP (interleaved) A. 1.44 PHYLIP (non-interleaved) A. 1.45 Raw A.1.38 NEXUS/PAUP 249 250 (nucleotide) A. 1.46 265 RefseqP 265 A. 1.47 SELEX A. 1.48 Staden A. 1.49 Strider 264 264 269 269 SwissProt A.1.51 Text/Plain A. 1.52 Treecon Supported 252 261 268 (obsolete) A.1.50 A.2 235 271 273 274 feature formats 275 XIII CONTENTS A.2.1 DASGFF A.2.2 EMBL, GenBank, DDBJ A.2.3 275 GFF3 280 A.2.4 GFF2 281 A.2.5 PIR/NBRF A.2.6 SwissProt 279 282 283 Supported alignment formats FASTA 284 A.3 A.3.1 A.3.2 MarkxO A.3.3 Markxl 284 285 A.3.4 Markx2 286 A.3.5 Markx3 287 A.3.6 MarkxlO A.3.7 Match A.3.8 MSF 284 288 A.3.9 289 289 Multiple 290 A.3.10 Pair A.3.11 Score A.3.12 Simple A.3.13 SRS 291 292 292 292 SRS Pair 293 TCOFFEE 294 A.3.14 A.3.15 A.3.16 Trace (debugging only) Supported report formats A.4 295 295 A.4.1 DAS GFF feature table A.4.2 Dbmotif A.4.3 Debug Diffseq A.4.4 A.4.5 297 report format A.4.7 298 298 EMBL feature table FeatTable 300 A.4.6 295 300 GenBank feature table 301 GFF feature table 301 A.4.8 A.4.9 Listfile A.4.10 Motif A.4.11 Nametable 301 302 A.4.12 304 P1R feature table A.4.13 Regions A.4.14 SeqTable A.4.15 SRS 307 308 SRS Simple A.4.16 A.4.17 306 306 310 A.4.18 SwissProt feature table Tab-delimited format A.4.19 Table A.4.20 TagSeq A.4.21 Trace feature table XIV 312 312 313 314 (debugging only) 317 CONTENTS Appendix B B.l Applications and packages reference Applications and packages documentation Online documentation B. 1.1 318 (release R6) packages (release R6) B.2 Application B.3 EMBASSY B.4 Applications groups 319 320 321 applications (release R6) 321 EMBASSY applications (available alongside EMBOSS release R6) B.4.1 EMBOSS B.4.2 B.4.3 All GCG B. 5 applications (by group) 329 to EMBOSS comparison 343 Appendix C Command line qualifier reference 361 Global qualifiers C. 2.8 361 Datatype-specific qualifiers Sequence input 361 Sequence output 363 Features 364 Alignments 364 Patterns 365 Outputs 365 Reports 368 Graphics 368 Appendix D Resources D. l EMBOSS C. l C.2 C.2.1 C.2.2 C.2.3 C.2.4 C.2.5 C.2.6 C.2.7 361 369 servers and D.l.l EMBOSS portals D.l.2 EMBOSS Index 318 318 servers portals 369 369 369 371 XV