Hi,
On 1/9/06, Rony Bill ronbillypop@yahoo.co.uk wrote:
JTD wrote:
If you or anyone else has a cluster running somewhere for graphics, could I get a short writeup on the hardware used, how it is joined together (pc to pc) and just a wee bit on its software and setup. It is just for virtual practicals. :)
Rony there are only 2 large installations that I have seen. A render farm typically consist about a few tens to few hundreds of dual processor HT / xeon (em64t) class systems with some expensive display cards and atleast a few gigs of high speed ram . needless to say about raid sata / scsi disk .
say if there are 11 boxes the first box serves as the grid master with 10 boxes running the grid engine client. the master distributes the task to the clients . the task can be copied over a nfs share on a network . this is for a company that some real anim work for movies etc.
u can certainly setup a lowerend system for small testing etc ... sun grid engine project might be a nice place to start.
maybe sejal can do a write up once they are up
Check out this month's PCQuest for instructions on setting up your own clustered super-computer. Uses the openmosix kernel patch for process migration. Other options are also discussed.
-RR
Check out this month's PCQuest for instructions on setting up your own clustered super-computer. Uses the openmosix kernel patch for process migration. Other options are also discussed.
*OpenMosix will not work with maya/mental ray Render Farm.
On Tuesday 10 January 2006 05:14, linux@trustedmachines.com wrote:
*OpenMosix will not work with maya/mental ray Render Farm.
Please elaborate your reply. From what I gather Rony is thinking of setting up a SunGrid cluster. I dunno if he is going to use Maya or Mental Ray...
On Tuesday 10 Jan 2006 10:00 pm, Dinesh Joshi wrote:
On Tuesday 10 January 2006 05:14, linux@trustedmachines.com wrote:
*OpenMosix will not work with maya/mental ray Render Farm.
Please elaborate your reply. From what I gather Rony is thinking of setting up a SunGrid cluster. I dunno if he is going to use Maya or Mental Ray...
Sorry for confusion.
Maya,mental ray and XSI(softimage) are quite popular software for animation application. I guess many animation companies must be using these software for front end drawing work and backend rendering work. I had tested openmosix for maya/mental ray/XSI about two years ago but it did not work. If I remember correctly following was the reason. At that time openmosix had some problem migrating processes those use mmap system call. I have not checked openmosix after that. Situation might have changed. So make a note if you are setting up cluster for render farm.
After that I used Sun Grid Engine and found it very good in performance and stability. We made about 5-6 clusters for render farm. Each cluster having about 25 machines with two xeon processors and 2 GB RAM. NFS with async option was used.
regards
linux@trustedmachines.com wrote:
After that I used Sun Grid Engine and found it very good in performance and stability. We made about 5-6 clusters for render farm. Each cluster having about 25 machines with two xeon processors and 2 GB RAM. NFS with async option was used.
6 Clusters x 25 machines of dual Xeon pro. and 2 GB RAM = 6 x 25 x 100K = 1.5 Crores approx.
What was the application?
I don't want to build a super-computer. My client will get a heart attack. :)
Regards,
Rony.
___________________________________________________________ Yahoo! Photos NEW, now offering a quality print service from just 8p a photo http://uk.photos.yahoo.com
6 Clusters x 25 machines of dual Xeon pro. and 2 GB RAM = 6 x 25 x 100K = 1.5 Crores approx.
Thats right.:)
What was the application?
It is a render farm setup in an animation company. Basically maya/mental ray/XSI are used for rendering animation sequence.
Regards
Balwinder
On Wednesday 11 January 2006 10:46, linux@trustedmachines.com wrote:
6 Clusters x 25 machines of dual Xeon pro. and 2 GB RAM = 6 x 25 x 100K = 1.5 Crores approx.
Thats right.:)
What was the application?
It is a render farm setup in an animation company. Basically maya/mental ray/XSI are used for rendering animation sequence.
There will be teams of people working simultaneously on multiple full length animations. Not exactly shaadi happy birthday stuff ;-)
linux@trustedmachines.com wrote:
It is a render farm setup in an animation company. Basically maya/mental ray/XSI are used for rendering animation sequence.
Today I installed the video edit system (hardware part) and there the client gave me more information on farming. It is mainly used for 3D animation and thats where the cpu draws maximum load. Once the 3D creator creates attributes and the script for the picture, the system has to process this info and render the result image. This takes a heavy toll on the system resources and so a full fledged rendering farm has to be setup. Sometimes one computer is used for each frame or even just a block within the frame. For resolution and details, sky is the limit. These farms are mainly used by giant movie studios in the West and full length animation films like Shrek are made in such farms.
Regards,
Rony.
___________________________________________________________ NEW Yahoo! Cars - sell your car and browse thousands of new and used cars online! http://uk.cars.yahoo.com/
On Tuesday 10 January 2006 01:47, Rajesh Rajani wrote:
Check out this month's PCQuest for instructions on setting up your own clustered super-computer. Uses the openmosix kernel patch for process migration. Other options are also discussed.
-RR
I would recommend using online resources rather than PCQuest.
Here are some links: http://howto.x-tend.be/openMosix-HOWTO/ http://www.linuxdevcenter.com/pub/a/linux/2004/02/19/openmosix.html http://openmosix.sourceforge.net/instant_openmosix_clusters.html
You can use ClusterKnoppix to try out setting up the cluster. It rocks. It's a live CD with OpenMosix. You can instantly setup a cluster! i have tried it. But I didn't have much hardware to do some realworld testing. Two computers dont exactly make up a cluster :)
Once you are satisfied with the results, you can install whichever distro you like on the harddisks. Also remember to use XFS, Reiser FS while setting up the cluster. These are very good high performance FSs. Ext2Fs, lets just say is a wee bit slow. But nevertheless I use it on my desktop and laptop. My debian server (P1 166MMX) ran both EXT2FS and XFS both and there is a noticable difference between the performance. XFS works much faster than EXT2FS on it ;)
On Tuesday 10 January 2006 21:58, Dinesh Joshi wrote:
You can use ClusterKnoppix to try out setting up the cluster. It rocks. It's a live CD with OpenMosix. You can instantly setup a cluster! i have tried it. But I didn't have much hardware to do some realworld testing. Two computers dont exactly make up a cluster :)
Once you are satisfied with the results, you can install whichever distro you like on the harddisks. Also remember to use XFS, Reiser FS while setting up the cluster. These are very good high performance FSs. Ext2Fs, lets just say is a wee bit slow. But nevertheless I use it on my desktop and laptop. My debian server (P1 166MMX) ran both EXT2FS and XFS both and there is a noticable difference between the performance. XFS works much faster than EXT2FS on it ;)
Xfs / jfs. Reiserfs is not as fast particularly on large files. Moreover the developer Hans Reiser seems to have continuos problems with the kernel developers. I however use reiserfs extensively and found it to be extraordinarily reliable under extreme conditions.
Hi Terrence,
On Tue, 2006-01-10 at 17:39, JTD wrote:
with the kernel developers. I however use reiserfs extensively and found it to be extraordinarily reliable under extreme conditions.
What is considered "extreme" conditions for a file system?
How one can determine reliability of a file systems?
-- rgds jtd
TIA With regards,
On Tuesday 10 January 2006 17:36, Dinesh Shah wrote:
Hi Terrence,
On Tue, 2006-01-10 at 17:39, JTD wrote:
with the kernel developers. I however use reiserfs extensively and found it to be extraordinarily reliable under extreme conditions.
What is considered "extreme" conditions for a file system?
Repeated power cycling.
How one can determine reliability of a file systems?
corruptions and recovery after corruption
These conditions are my conditions of course. In comparison ext2 and ext3 both corrupted far more number of times and failed both automatic and manual recovery.
On 10/01/06 18:09 +0530, JTD wrote:
On Tuesday 10 January 2006 17:36, Dinesh Shah wrote:
Hi Terrence,
On Tue, 2006-01-10 at 17:39, JTD wrote:
with the kernel developers. I however use reiserfs extensively and found it to be extraordinarily reliable under extreme conditions.
What is considered "extreme" conditions for a file system?
Repeated power cycling.
Nah. Try database WAL logs, MTA queues. Reiser 3 has been known to corrupt under write load. Not trustworthy enough.
Devdas Bhagat
I am very sorry but have i voilated any list rules, I am unable to post any messages to the list. I get a msg from the list moderator that my post is waiting for approval. I had sent 2 mails to the list since yesterday but they did not comeup till today morning so i canclled those posts.
Sejal Patel
On Tuesday 10 Jan 2006 5:41 pm, Sejal Patel wrote:
I am very sorry but have i voilated any list rules, I am unable to post any messages to the list. I get a msg from the list moderator that my post is waiting for approval. I had sent 2 mails to the list since yesterday but they did not comeup till today morning so i canclled those posts.
afaik the only rule for moderation is if your post is more than 7 kb, or if it contains html or if it is addressed to more than 4 or 5 persons - and all these are spam prevention measures. Breach of etiquette and rules is dealt with by polite warnings or flames, not by putting the list member in moderation jail
On 1/10/06, Kenneth Gonsalves lawgon@thenilgiris.com wrote:
On Tuesday 10 Jan 2006 5:41 pm, Sejal Patel wrote:
I am very sorry but have i voilated any list rules, I am unable to post any messages to the list. I get a msg from the list moderator that my post is waiting for approval. I had sent 2 mails to the list since yesterday but they did not comeup till today morning so i canclled those posts.
afaik the only rule for moderation is if your post is more than 7 kb,
Can 5 lines text be more than 7 kb
or if it contains html
Pure text
or if it is addressed to more than 4
ask moderators to check my mail headers if am send it to multiple receipients
or
5 persons - and all these are spam prevention measures. Breach of etiquette and rules is dealt with by polite warnings or flames, not by putting the list member in moderation jail
Bye
-- Regards, Rohit Baisakhiya KiranInfotech
On Tuesday 10 Jan 2006 6:08 pm, Rohit Baisakhiya wrote:
ask moderators to check my mail headers if am send it to multiple receipients
from the headers on this mail it doesnt look like you are being moderated. Are you?
On 1/10/06, Rohit Baisakhiya rohitbaisakhiya@gmail.com wrote:
On 1/10/06, Kenneth Gonsalves lawgon@thenilgiris.com wrote:
On Tuesday 10 Jan 2006 5:41 pm, Sejal Patel wrote:
I am very sorry but have i voilated any list rules, I am unable to post any messages to the list. I get a msg from the list moderator that my post is waiting for approval. I had sent 2 mails to the list since yesterday but they did not comeup till today morning so i canclled those posts.
afaik the only rule for moderation is if your post is more than 7 kb,
Sorry for posting from a colleges account.
Can 5 lines text be more than 7 kb
or if it contains html
Pure text
or if it is addressed to more than 4
ask moderators to check my mail headers if am send it to multiple receipients
or
5 persons - and all these are spam prevention measures. Breach of etiquette and rules is dealt with by polite warnings or flames, not by putting the list member in moderation jail
Bye
-- Regards, Rohit Baisakhiya KiranInfotech -- http://mm.ilug-bom.org.in/mailman/listinfo/linuxers
--- Sejal Patel sejallinuxpatel@gmail.com wrote: Wow. That is some commitment. She is married to Linux. :0) Now even the blue screen of death cannot do you apart.
-abhi
*********************************************************************** Faith, by definition, defies evidence: it is untested and unshakeable, and is therefore in direct contradiction with science. ***********************************************************************
__________________________________________ Yahoo! DSL Something to write home about. Just $16.99/mo. or less. dsl.yahoo.com
Sometime Today, KG cobbled together some glyphs to say:
5 persons - and all these are spam prevention measures. Breach of etiquette and rules is dealt with by polite warnings or flames, not by putting the list member in moderation jail
New members are in moderation until they show a level of cluefulness. Old members who repeatedly violate list etiquette are put into moderation jail.
HTML is stripped automatically.
On Tuesday 10 Jan 2006 6:58 pm, Philip Tellis wrote:
Sometime Today, KG cobbled together some glyphs to say:
5 persons - and all these are spam prevention measures. Breach of etiquette and rules is dealt with by polite warnings or flames, not by putting the list member in moderation jail
New members are in moderation until they show a level of cluefulness. Old members who repeatedly violate list etiquette are put into moderation jail.
this is bad. The first post of a new member should be moderated to check if he is not a spammer. Old members who breach etiquette should be flamed - not moderated. I personally pledge to make life so miserable for these guys that they desist. Admins - please dont jail ppl for breach of etiquette - it is irritating, but not a crime. I prefer a topposting, crossposting linux guy to a windoze guy.
On Tuesday 10 January 2006 17:41, Sejal Patel wrote:
I am very sorry but have i voilated any list rules,
Yikees. U just hijacked the thread.
I am unable to post any messages to the list. I get a msg from the list moderator that my post is waiting for approval. I had sent 2 mails to the list since yesterday but they did not comeup till today morning so i canclled those posts.
Sejal Patel
-
Abhishek Daga -
Devdas Bhagat -
Dinesh Joshi -
Dinesh Shah -
JTD -
Kenneth Gonsalves -
linux＠trustedmachines.com -
Philip Tellis -
Rajesh Rajani -
Rohit Baisakhiya -
Rony Bill -
Sejal Patel