Re: production hanging
Re: production hanging
- Subject: Re: production hanging
- From: Q <email@hidden>
- Date: Thu, 29 Nov 2012 09:43:23 +1000
If you are doing concurrent dispatch then this might be worth doing even after they have been running for a while. It could be that you have a deadlock issue and are slowly deadlocking all your worker threads over time until eventually they all become non-responsive and the app instance is effectively dead in the water.
On 29/11/2012, at 6:39 AM, Chuck Hill <email@hidden> wrote:
> Try running jstack on them when the start not responding:
>
> jstack -F <process id>
>
> That will give you a thread dump and may show something.
>
> Have you looked in the logs for OutOfMemory and HeapSpace? It could be running out of PermGen space
>
> Are you dispatching requests concurrently?
>
>
> Chuck
>
>
> On 2012-11-28, at 12:05 PM, Michael Gargano wrote:
>
>> Hi all,
>>
>> I’m having an issue in our production environment. I have two servers (vm’s w/ windows 2008 r2 64-bit) running two instances each. The servers are load balanced by a hardware load balancer that pings the app on each box every minute to determine if it is still up (because of the way our app works, this creates a session). After about a week of uptime, the each app instance seems to just stop responding to requests one at a time until no instances respond any more. The java processes are still always running, but nothing responds. I recently bumped up the mem. on the apps to 3G each, to see if that would help, but the same problem occurred. Any ideas why this might be happening? It’s not good. Below is a sample of the app switches…
>>
>> -WOPort 2001 -WOCachingEnabled YES -WODebuggingEnabled NO -WOOutputPath c:/logs/log-1 -WOAutoOpenInBrowser NO -WOAutoOpenClientApplication NO -WOLifebeatInterval 120 -WOLifebeatEnabled YES -WOLifebeatDestinationPort 1085 -WOAdaptor WODefaultAdaptor -WOWorkerThreadCount 8 -WOListenQueueSize 128 -WOWorkerThreadCountMin 16 -WOWorkerThreadCountMax 256 -NSProjectSearchPath () -WOSessionTimeOut 1800 -WOApplicationName eGM -WOMonitorEnabled YES -WONoPause YES -Xmx3g -WOAllowsConcurrentRequestHandling YES
>>
>>
>> Thanks.
>> -Mike
>>
>> _______________________________________________
>> Do not post admin requests to the list. They will be ignored.
>> Webobjects-dev mailing list (email@hidden)
>> Help/Unsubscribe/Update your Subscription:
>>
>> This email sent to email@hidden
>
> --
> Chuck Hill Senior Consultant / VP Development
>
> Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems.
> http://www.global-village.net/gvc/practical_webobjects
>
> Global Village Consulting ranks 13th in 2012 in BIV's Top 100 Fastest Growing Companies in B.C!
> Global Village Consulting ranks 76th in 24th annual PROFIT 200 ranking of Canada’s Fastest-Growing Companies by PROFIT Magazine!
>
>
>
>
>
>
>
>
>
> _______________________________________________
> Do not post admin requests to the list. They will be ignored.
> Webobjects-dev mailing list (email@hidden)
> Help/Unsubscribe/Update your Subscription:
>
> This email sent to email@hidden
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden