Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 10
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 1941 times and has 9 replies Next Thread
Hypernova
Master Cruncher
Audaces Fortuna Juvat ! Vaud - Switzerland
Joined: Dec 16, 2008
Post Count: 1908
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
But how many HCC diffraction images exist?

Up to now there are 461 Million results returned for HCC
Thanks to GPU crunching the number of results produced has increased dramatically.
We were said that a WU contains two diffraction images to be analysed. This means that we have already analysed nearly 800 Million diffraction images.
My question here to the scientists is, where do so many diffraction images come from. I suppose that to generate a unique image takes time. There are for sure databases of images but such a huge number is mind boggling. Then comes the question, but how many such images do exist in the whole world.
This may also bring an answer to the question, but how many WUs are left.
----------------------------------------

[Mar 15, 2013 8:25:07 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

X-ray Crystallography is done in many labs around the world and supplying HCC labs, but not all, just those who're seeing this as fitting their research I suppose.

Considering that IIRC 1536 different filters are applied to shooting 1 image, it seems not difficult to create very large numbers. The image generation is highly automated.

Not heard a peep different of "end of Q2-13", but things have been going massively faster. Voodoo calc applied many months ago, we're now about 50 days away from steady supply [things started running faster now that "just" 7 sciences are active at WCG. The prediction was made at time of having 10 or 11 active... and participation seems to keep growing. Likely will more if the 7.0.xx client is endorsed and members discover the easy config ways, stead of that horrible app_info [app_config.xml can now be read in via the menu and acted on by client on the fly... personally tested the <max_concurrent> function... but as usual, wandering off topic]

Official word... the mod-admin will read and maybe polls the PI for a brief update.
[Mar 15, 2013 8:46:37 AM]   Link   Report threatening or abusive post: please login first  Go to top 
johncmacalister2010@gmail.com
Veteran Cruncher
Canada
Joined: Nov 16, 2010
Post Count: 799
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

X-ray Crystallography is done in many labs around the world and supplying HCC labs, but not all, just those who're seeing this as fitting their research I suppose.

Considering that IIRC 1536 different filters are applied to shooting 1 image, it seems not difficult to create very large numbers. The image generation is highly automated.

Not heard a peep different of "end of Q2-13", but things have been going massively faster. Voodoo calc applied many months ago, we're now about 50 days away from steady supply [things started running faster now that "just" 7 sciences are active at WCG. The prediction was made at time of having 10 or 11 active... and participation seems to keep growing. Likely will more if the 7.0.xx client is endorsed and members discover the easy config ways, stead of that horrible app_info [app_config.xml can now be read in via the menu and acted on by client on the fly... personally tested the <max_concurrent> function... but as usual, wandering off topic]

Official word... the mod-admin will read and maybe polls the PI for a brief update.


Ooooh, joy. I cannot wait for the death of the frustrating config files which have caused maddening issues for me. If the new client provides a better interface I believe participation will grow. Bring it on!!!!!
----------------------------------------


crunching, crunching, crunching.

AMD Ryzen 5 2600 6-core Processor with Windows 11 64 Pro.

AMD Ryzen 7 3700X 8-Core Processor with Windows 11 64 Pro (part time)


smile
[Mar 15, 2013 12:59:28 PM]   Link   Report threatening or abusive post: please login first  Go to top 
twilyth
Master Cruncher
US
Joined: Mar 30, 2007
Post Count: 2129
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

i don't know what proteins are the subject of the study, but many are, at least partially, "intrinsically disordered" which means that they have no predefined topology or 3D structure. I'm not sure how that impacts the use of x-ray crystallography or if the technique just isn't used for proteins that have large, disordered domains.

Here is great article to read if you're interested in protein structure. It's only a few pages long and very comprehensible.
----------------------------------------


[Mar 18, 2013 4:56:15 AM]   Link   Report threatening or abusive post: please login first  Go to top 
Jim1348
Veteran Cruncher
USA
Joined: Jul 13, 2009
Post Count: 1066
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

twilyth,

That is a good article. Thanks.
[Mar 18, 2013 1:34:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
NixChix
Veteran Cruncher
United States
Joined: Apr 29, 2007
Post Count: 1187
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

Don't forget you must divide the 461 million results (now 465 million) by the replication factor of two. So the number of images processed now stands at 465 million. shock Shooting multiple images of a single sample under different conditions, techniques or filters makes much sense from the scientific point of view.

Cheers coffee
----------------------------------------

[Mar 18, 2013 3:03:41 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Sgt.Joe
Ace Cruncher
USA
Joined: Jul 4, 2006
Post Count: 7579
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

i don't know what proteins are the subject of the study, but many are, at least partially, "intrinsically disordered" which means that they have no predefined topology or 3D structure. I'm not sure how that impacts the use of x-ray crystallography or if the technique just isn't used for proteins that have large, disordered domains.

Here is great article to read if you're interested in protein structure. It's only a few pages long and very comprehensible.

It is a great article. It shows the more you know, the more questions become apparent that that you want to know. It turns out the protein world is a lot more complex than we thought even a few years ago.
Cheers
----------------------------------------
Sgt. Joe
*Minnesota Crunchers*
[Mar 18, 2013 3:40:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
cubes
World Community Grid Tech, Mapping Cancer Markers and Help Conquer Scientist
Canada
Joined: Mar 3, 2007
Post Count: 58
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

Good question, Hypernova. The replication factor and the number of work units per result have each changed over the course of the project, so the 461 million results do not translate directly to an image count.

The HCC images aren't actually diffraction images. They are images of a prior step in the X-ray crystallography pipeline -- crystallization trials. Whereas a small number of diffraction images are needed to turn a protein crystal into a solved structure, a typical protein crystal is the product of hundreds or thousands of crystallization experiments, each observed at multiple time points.

In the case of HCC, our images are from the High-Throughput Screening Lab at the Hauptman-Woodward Medical Research Institute at the University of Buffalo. Their main crystallization screen tests target proteins against a battery of 1,536 different chemical "cocktails". Each trial (one protein + one cocktail) is photographed between 6 and 10 times over a period of several weeks.

As NixChix suggested, these multiple conditions (sometimes including filters to control for lighting conditions) multiply the number of images generated per protein. I'm sorry I don't have an exact count right now. More images are being generated constantly. We'll put out an update soon that mentions the number remaining for this project.

twilyth, thanks for the article. Disorder in a proteins is a major difficulty in protein crystallization and structure solution. Often, specific disordered regions can be identified (or at least predicted) in the protein's amino acid sequence, and a modified version of the protein can be created with a better chance of crystallization and ultimately, structure solution. Sometimes (as in the article), co-crystallizing a protein with its interacting partner is the answer.


Christian A. Cumbaa
Research Associate, Ontario Cancer Institute
[Mar 27, 2013 4:55:57 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Former Member
Cruncher
Joined: May 22, 2018
Post Count: 0
Status: Offline
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

Thank you for clarifying this point, Dr. Cumbaa. So we should expect 9 thousand to 15 thousand images for each protein run through the High Throughput line. And as you told twilyth, there may be multiple runs for a protein.

No wonder there is no simple correlation between the number of images and the number of proteins under investigation.

idea
Lawrence
[Mar 27, 2013 7:44:50 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Hypernova
Master Cruncher
Audaces Fortuna Juvat ! Vaud - Switzerland
Joined: Dec 16, 2008
Post Count: 1908
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: But how many HCC diffraction images exist?

Thanks for all these clarifications. It is easy to see that the hundreds of millions of WU's are in the end perfectly related to the proteins investigated and does not seem anymore such an absurd number.

On the other hand it also shows that in this field of research to do a full screening when one considers so many factors and combinations of factors you go immediately to enormous numbers, and this justifies grid computing as the only acceptable way to run through such large numbers in an acceptable timeframe.
It also would justify GPU crunching as a way to manage larger projects 10 to 20 times the size of what just CPU crunching would allow.
----------------------------------------

[Apr 20, 2013 6:44:19 AM]   Link   Report threatening or abusive post: please login first  Go to top 
[ Jump to Last Post ]
Post new Thread