{"id":213,"date":"2013-12-21T17:56:15","date_gmt":"2013-12-21T17:56:15","guid":{"rendered":"http:\/\/blueskiesbenchspace.org\/blog\/?p=213"},"modified":"2013-12-23T19:31:33","modified_gmt":"2013-12-23T19:31:33","slug":"dr-westons-yuletide-guide-to-scientific-discovery","status":"publish","type":"post","link":"http:\/\/blueskiesbenchspace.org\/blog\/?p=213","title":{"rendered":"Dr Weston&#8217;s Yuletide guide to scientific discovery"},"content":{"rendered":"<div id=\"attachment_215\" style=\"width: 310px\" class=\"wp-caption alignleft\"><a href=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Jamess-lion.jpg\"><img aria-describedby=\"caption-attachment-215\" decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-215 \" alt=\"Not quite the real thing...\" src=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Jamess-lion-300x224.jpg\" width=\"300\" height=\"224\" srcset=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Jamess-lion-300x224.jpg 300w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Jamess-lion-1024x766.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-215\" class=\"wp-caption-text\">Not quite the real thing: science is sometimes simplified a tiny bit too much<\/p><\/div>\n<p>What\u2019s it like to make a discovery? Viewed from the outside, the path to scientific glory is as follows: scientists, serious, white-coated individuals in safety glasses, work long hours in the lab meticulously replicating their experiments until a conclusion is reached; at some point this involves holding a tube or petri dish and looking intently at the contents and\/or staring at something complicated on a computer;<\/p>\n<div id=\"attachment_216\" style=\"width: 215px\" class=\"wp-caption alignright\"><a href=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Downward-copy.jpg\"><img aria-describedby=\"caption-attachment-216\" decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-216\" alt=\"...staring intently at a petri dish, Downward style\" src=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Downward-copy-205x300.jpg\" width=\"205\" height=\"300\" srcset=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Downward-copy-205x300.jpg 205w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Downward-copy-700x1024.jpg 700w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/Downward-copy.jpg 1470w\" sizes=\"(max-width: 205px) 100vw, 205px\" \/><\/a><p id=\"caption-attachment-216\" class=\"wp-caption-text\">&#8230;staring intently at a petri dish, Downward style<\/p><\/div>\n<p>then, the results are written up, submitted to a journal, and get published. If they\u2019re exciting enough, somebody tells the newspapers, and the world finds out. Well, it\u2019s a bit like that, but only in the same way that a toddler\u2019s drawing resembles the original. Here\u2019s what really happens:<\/p>\n<p><strong>1.<\/strong> Somebody asks a question. Sometimes it\u2019s entirely novel, reached by a long process based on logical deduction and formulation of hypotheses, or sometimes it\u2019s so totally obvious that everyone is surprised that nobody seems to have thought of asking it before (sometimes, someone <i>has<\/i> asked it before, but in a different context; nicking ideas like this is called Doing Crossover Research, and is much lauded). Usually, it\u2019s somewhere in between these two extremes.<\/p>\n<p><strong>2a<\/strong>. Is there a way of answering the question? If not, it sits in lonely splendour at the top of a \u201cto-do\u201d list for anything between days and years, waiting for the field to advance technologically and intellectually until there is a way of approaching it.<\/p>\n<p><strong>2b<\/strong>. Is there <i>almost<\/i> a way of answering the question? If so, someone with whizzo technical skills will be lumbered with figuring out how to adapt equipment and methodology to suit. Fixing this can take a really long time.<\/p>\n<p><strong>2c<\/strong>. If there are existing methods that work, experiments can begin. NB if the method in question is new, for a short time, a few places in the world that have the kit and know-how will have an edge; recognising and exploiting this to do really important stuff is a crucial skill in climbing the greasy pole to scientific success.<\/p>\n<p><strong>3.<\/strong> Have you got enough money to pay for the research? If you have hit the jackpot and work in an institute with core funding (like the ICRF\/LRI), then you probably do. What\u2019s even better, you\u2019ll be able to try out some risky experimental strategies before the people with the purse strings notice and try to get you to do something safer. If you rely on applying for grants, you may struggle to get money if you don\u2019t have a good track record, if your idea is too off the wall, or if you simply don\u2019t make the cut for funding even if the grants committee approves your proposal. At this point, you can try writing a grant for something a bit safer, hope it gets funded, and drizzle some of the grant into your Big Unfundable Idea on the quiet.<\/p>\n<p><strong>\u00a04.<\/strong> Who\u2019s going to do the work? If you\u2019re talented at the bench and young, you can do it by yourself or with minimal assistance \u2013 a research assistant, or a PhD student perhaps. This is probably the most satisfying way to do experiments; the point in their careers when such single-minded creativity is possible is the<\/p>\n<div id=\"attachment_218\" style=\"width: 218px\" class=\"wp-caption alignleft\"><a href=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/tyler.jpg\"><img aria-describedby=\"caption-attachment-218\" decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-218 \" alt=\"Tyler Jacks trying to have a personal life, 2005\" src=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/tyler-208x300.jpg\" width=\"208\" height=\"300\" srcset=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/tyler-208x300.jpg 208w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/tyler-711x1024.jpg 711w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/tyler.jpg 880w\" sizes=\"(max-width: 208px) 100vw, 208px\" \/><\/a><p id=\"caption-attachment-218\" class=\"wp-caption-text\">Tyler Jacks trying to have a personal life, 2005<\/p><\/div>\n<p>time that most scientists remember with great fondness. \u00a0If you\u2019re running a lab, and have any outside interests such as a family or a personal life, you won\u2019t have time to do the work by yourself, what with grants and papers to write, babies or boyfriends to nurture, committees to sit on and endless paperwork to do (not to mention rewriting your last mediocre student\u2019s PhD thesis). In any case you\u2019ve probably retired from the bench into an office, and you\u2019re just going to have to delegate. Do you have a talented postdoc (I mean a <i>really <\/i>talented postdoc, not just the seminarspeak sort) or a genius graduate student, or a brilliant technician? If so, you\u2019re in clover; buy them lots of chocolate or whatever their lab stimulant of choice is, be extremely nice and attentive to them, and watch your dreams come true. If not, prepare to get very frustrated. There\u2019s nothing worse than watching somebody else cocking up an experiment you know you could do with your eyes shut if you <i>just had the time.<\/i> Under no circumstances try shouting and throwing things; labs do not thrive when the lab head resembles the place on the horse where the sun doesn\u2019t shine.\u00a0 Breathe deeply,\u00a0 and be gentle with your colleagues. With luck, you\u2019ll get there anyway, and they in turn will be vastly improved scientists.<\/p>\n<p><strong>\u00a05.<\/strong> Now you\u2019ve got your data, are they correct? An alarmingly large proportion of published papers are wrong (somewhere between 14% and 75% depending on who you believe), not because of fraud, but because exceptional new results are more likely to be exceptional deviations from what\u2019s actually true, but everyone wants to believe them anyway. Check, double check, do the statistics (<i>properly<\/i>, not just using an excel spreadsheet function you don\u2019t really understand; you\u2019re just going to have to find a good statistician). Never ignore anything, never discard the dirty data that don\u2019t match the one beautiful clean result that supports your hypothesis. Negative results matter just as much as positive ones.<\/p>\n<p><strong>\u00a06.<\/strong> Don\u2019t get scooped. Don\u2019t tell your results to anyone you don\u2019t know and trust, and if possible, bind them to secrecy. In the old days, results were shared prior to publication by speaking about them at conferences, mailing them around the world as preprints of manuscripts in preparation, and talking to colleagues. The community was small enough that pinching someone else\u2019s data and passing it off as your own was quite hard to do, although not unknown. Unfortunately, a culture grew up whereby, upon hearing about your data, another lab that was almost there but not quite would ramp up their activities and try to rush a paper out in a competing journal. Gradually, enough people got burned by this practice that nowadays, conferences have become vehicles for discussing published or soon-to-be published work; they exist in the recent past (or in some cases, the historic past), rather than the present. So, keep very quiet, and write up very fast, ensuring, of course, that condition (5) applies. If you\u2019ve detected that rushing into print and being quite sure of the veracity of your data are sometimes mutually exclusive, you&#8217;re correct.<\/p>\n<p><strong>\u00a07.<\/strong> If you\u2019ve done the work yourself, writing a paper is relatively simple, assuming someone has at some point taught you how to write clearly and concisely. Write down what you did, have some trusted colleagues critique your paper, and send it to a journal. If your lab is involved, things get more complicated. Your desire to educate your lab members in the correct writing of papers may turn out to be in direct opposition to your desire to produce a compittentllie spellt and well-argued manuscript in less than a decade. Persevere, but be aware that it\u2019s going to hurt. Possibly a lot.<\/p>\n<p><strong>\u00a08.<\/strong> Select a journal. How brave are you? Are you going to eschew <i>Cell, Nature <\/i>and <i>Science<\/i>, the \u201cluxury\u201d journals to which Randy Schekman, 2013 Nobel Laureate in Physiology and Medicine <a href=\"http:\/\/www.theguardian.com\/science\/2013\/dec\/09\/nobel-winner-boycott-science-journals\">is so opposed<\/a>? Many people complain that the scientific judgment of the top-dog publications is severely compromised by their desire to publish high profile papers, and that like all manufacturers of luxury goods, they have conned the scientific community into believing that exclusivity is the same as importance. However, many of these same people still publish there if they possibly can, as papers in top journals equate to jobs, status, and grants. There\u2019s a need for a revolution in science publishing, but that\u2019s a topic for another day.<\/p>\n<p><strong>\u00a09.<\/strong> Send your paper off. If you\u2019ve gone for <i>Cell, Nature <\/i>or <i>Science<\/i>, prepare to receive it back almost as soon as you\u2019ve finished wrestling with their devilish online submission software, guaranteed to transform even the most steadfast soul into a sobbing piece of human wreckage. Argue with them (politely), and if they continue to say no, send it somewhere else. Repeat software wrestling process, perhaps after copious doses of your favourite beverage choice. If paper pings back faster than a speeding bullet once more, keep going until a journal with proper editors realises that your magnum opus is worth sending out for peer review.<strong>\u00a0<\/strong><\/p>\n<div id=\"attachment_217\" style=\"width: 232px\" class=\"wp-caption alignleft\"><a href=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/mike.jpg\"><img aria-describedby=\"caption-attachment-217\" decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-217   \" alt=\"\" src=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/mike-222x300.jpg\" width=\"222\" height=\"300\" srcset=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/mike-222x300.jpg 222w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/mike-759x1024.jpg 759w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/mike.jpg 829w\" sizes=\"(max-width: 222px) 100vw, 222px\" \/><\/a><p id=\"caption-attachment-217\" class=\"wp-caption-text\">Mike Bishop, 1989. Just once in my career, I published in Cell without revision. The identity of the co-author may have helped a bit.<\/p><\/div>\n<p><strong>10.<\/strong> Receive reviews. <i>Do not<\/i> open any email which may contain reviewers\u2019 comments in front of young, impressionable lab members, particularly if it is their first attempt into print; you may cause untold lasting damage to their psyches. Appropriate reactions to reviews are outlined below:<\/p>\n<ul>\n<li>If the reviewers all love your paper and have recommended publication with no revision, you are in fact asleep. Enjoy your dream while you can; it is unlikely to be matched in reality.<\/li>\n<li>The reviewers like your paper and although they have suggested a few simple changes and perhaps some straightforward extra experiments, they want to see it published. Pinch yourself, because you may still be in the Land of Nod. If actually awake, celebrate wildly.<\/li>\n<li>The reviewers <i>quite <\/i>like your paper and have suggested some pretty hard extra experiments that may take a long time. It\u2019s still a yes though, so worth some moderate celebration, coupled with indignant shouting about how obtuse they\u2019ve been: can\u2019t the blasted journal editor see the experiments the reviewers have recommended are a waste of time?<\/li>\n<li>Nope, they don&#8217;t like it at all. The comments range from personal attacks calling into question the authors\u2019 probity and intelligence, to polite but merciless intellectual disembowelling. Get very cross. When you&#8217;ve calmed down, read the comments again and see if they\u2019ve got a point. Regroup, rewrite if necessary, do some more experiments if necessary, and return to stage 9. Repeat stages 9 and 10 <i>ad<\/i> not-quite <i>infinitum<\/i> but probably <i>nauseam<\/i>.<\/li>\n<\/ul>\n<p><strong>11.<\/strong> This is the best bit. You\u2019ve got your paper into a decent journal that people actually read. You can talk about your work to all and sundry, and if you\u2019re on the conference circuit, you have a new story to tell. You feel fantastic! Your lab is flying high, you\u2019re getting invitations to give seminars in fancy places, and perhaps you\u2019ve just done a tv interview that your Mum is going to love. Dreams of future career greatness preoccupy your waking thoughts.<\/p>\n<div id=\"attachment_219\" style=\"width: 310px\" class=\"wp-caption alignright\"><a href=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/my-tbe-dyes.jpg\"><img aria-describedby=\"caption-attachment-219\" decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-219\" alt=\"Did not have a problem thinking of the next big question: Fred Sanger, \u00a9 National Portrait Gallery, London\" src=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/my-tbe-dyes-300x300.jpg\" width=\"300\" height=\"300\" srcset=\"http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/my-tbe-dyes-300x300.jpg 300w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/my-tbe-dyes-150x150.jpg 150w, http:\/\/blueskiesbenchspace.org\/blog\/wp-content\/uploads\/2013\/12\/my-tbe-dyes.jpg 501w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><p id=\"caption-attachment-219\" class=\"wp-caption-text\">Did not have a problem thinking of the next big question: Fred Sanger, \u00a9 National Portrait Gallery, London<\/p><\/div>\n<p>But\u2026<\/p>\n<p><strong>\u00a012.<\/strong> Now you\u2019ve got to do it all over again or you won\u2019t get any more grants, applicants for places in your lab, pay rises, kudos, tv time\u2026. Aargh!!!<\/p>\n<p>And so\u2026<\/p>\n<p>Back to <strong>step 1<\/strong> again. Go on, you know you enjoy it really.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What\u2019s it like to make a discovery? Viewed from the outside, the path to scientific glory is as follows: scientists, serious, white-coated individuals in safety glasses, work long hours in the lab meticulously replicating their experiments until a conclusion is reached; at some point this involves holding a tube or petri dish and looking intently [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"_links":{"self":[{"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/213"}],"collection":[{"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=213"}],"version-history":[{"count":6,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/213\/revisions"}],"predecessor-version":[{"id":225,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=\/wp\/v2\/posts\/213\/revisions\/225"}],"wp:attachment":[{"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=213"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=213"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/blueskiesbenchspace.org\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=213"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}