From owner-nwchem-users@emsl.pnl.gov Fri Jul 11 13:50:19 2008 Received: from odyssey.emsl.pnl.gov (localhost.pnl.gov [127.0.0.1]) by odyssey.emsl.pnl.gov (8.14.1/8.14.1) with ESMTP id m6BKoIHl002800 for ; Fri, 11 Jul 2008 13:50:19 -0700 (PDT) Received: (from majordom@localhost) by odyssey.emsl.pnl.gov (8.14.1/8.14.1/Submit) id m6BKoII6002799 for nwchem-users-outgoing-0915; Fri, 11 Jul 2008 13:50:18 -0700 (PDT) X-Authentication-Warning: odyssey.emsl.pnl.gov: majordom set sender to owner-nwchem-users@emsl.pnl.gov using -f X-IronPort-AV: E=Sophos;i="4.30,347,1212390000"; d="scan'208";a="79521757" Message-ID: <4877C787.9070004@pnl.gov> Date: Fri, 11 Jul 2008 13:50:15 -0700 From: Dunyou Wang User-Agent: Thunderbird 2.0.0.14 (X11/20080421) MIME-Version: 1.0 To: "Tsai, Ming-Kang" CC: nwchem-users@emsl.pnl.gov Subject: Re: [NWCHEM] TCE: limit of available ga space References: In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 11 Jul 2008 20:50:14.0657 (UTC) FILETIME=[B7FF0710:01C8E397] Sender: owner-nwchem-users@emsl.pnl.gov Precedence: bulk Hi Ming-Kang, BlueGene/L is a 32 bit platform, so the maximum size of doubles of a global array can hold is 2^31. Best Dunyou Tsai, Ming-Kang wrote: > Hi there, > > I was testing various TCE calculations on our BlueGeneL in BNL. > I found out it seems to have a limit for the available GA space size. > I was requesting 500 memory per node. > > For 32 node jobs, the available ga space is 1048575550 doubles = 250mb * > 32 = 8000 mb However, when I ran 128 node, the available ga space is > 2147483647 doubles. For anything running on 128 or more nodes, the size > would still be 2147483647 doubles. > > Can any expert shine a light on this problem? I guess I need to change > the GA configuration to break this 2147483647 doubles limit but I can > not see where to do it. > > Thanks in advance. > > Ming-Kang (Brad) Tsai > Chemistry Department > Brookhaven National Laboratory > TEL: (631)344-4369 > FAX: (631)344-5815 >