Author Topic: 500 Internal Server Error/502 Bad Gateway  (Read 62398 times)

Online AsherO

  • Global Moderator
  • Dansdeals Lifetime 20K Presidential Platinum Elite
  • **********
  • Join Date: May 2008
  • Posts: 20772
  • Total likes: 181
  • DansDeals.com Hat Tips 74
    • View Profile
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #195 on: November 19, 2012, 12:37:26 AM »
if it bothers you that much then leave

At some point people will (perhaps have already). Though Dan has been making an effort to tweak the servers to fix whatever is wrong, and IME the situation has drastically improved. So kudos to Dan for the effort.
PGF24BMGS

Offline Moishebatchy

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Jun 2011
  • Posts: 7214
  • Total likes: 44
  • DansDeals.com Hat Tips 23
    • View Profile
  • Location: Jerusalem
  • Programs: Arzei Makolet Platinum, Yossi's Makolet Silver, Yesh! Gold, Rav Kav Dirt
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #196 on: November 19, 2012, 05:25:22 AM »
This is f****ning.

"Fattening"?

Maybe get off DDF and go get some exercise. ;D

Offline Moishebatchy

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Jun 2011
  • Posts: 7214
  • Total likes: 44
  • DansDeals.com Hat Tips 23
    • View Profile
  • Location: Jerusalem
  • Programs: Arzei Makolet Platinum, Yossi's Makolet Silver, Yesh! Gold, Rav Kav Dirt
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #197 on: November 19, 2012, 05:26:59 AM »
Though Dan and BAHayman have been making an effort to tweak the servers to fix whatever is wrong, and IME the situation has drastically improved. So kudos to Dan and BAHayman for the effort.

FTFY

Online AsherO

  • Global Moderator
  • Dansdeals Lifetime 20K Presidential Platinum Elite
  • **********
  • Join Date: May 2008
  • Posts: 20772
  • Total likes: 181
  • DansDeals.com Hat Tips 74
    • View Profile
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #198 on: November 19, 2012, 05:29:41 AM »
FTFY

Shlucho she'll adam k'moso :P

But fair enough, thanks and kudos to BAHayman as well :)
PGF24BMGS

Offline Dan

  • Administrator
  • Dansdeals Lifetime 50K Presidential Platinum Elite
  • **********
  • Join Date: May 2008
  • Posts: 55125
  • Total likes: 3128
  • DansDeals.com Hat Tips 16441
  • Gender: Male
    • View Profile
  • Location: CLE
  • Programs: UA Global Services, AA Lifetime Plat, DL Dirt, SPG Plat, Hyatt Diamond, Fairmont Lifetime Plat, Hilton Diamond, Priority Club Plat, Avis Chairman, National EE, Hertz PC
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #199 on: November 19, 2012, 09:06:19 AM »
FWIU from BAHayman is that it's not a server issue that can be easily solved by moving the site elsewhere as he has done in the past for us but a bug in the php script that's acts up on occasion and is very hard to pinpoint.  It drives CPU levels from 50-75% up to 400% which is when people get the 502s.

If anyone knows any troubleshooters for such an issue I'm all ears.  In the meantime his tweaks have definitely improved the situation over the past few weeks.
Save your time, I don't answer PM. Post it in the forum and a dedicated DDF'er will get back to you as soon as possible.

Offline AJK

  • Dansdeals Lifetime 20K Presidential Platinum Elite
  • ********
  • Join Date: Jun 2011
  • Posts: 25204
  • Total likes: 299
  • DansDeals.com Hat Tips 14
  • Gender: Male
    • View Profile
  • Programs: United Concierge Key; Delta Global Services; American Chairman; US Airways 1K; Hilton Sapphire; Hyatt Tritium; Marriott Californium; Starwood Kryptonium; Hertz Plutonium; National Adamantium, Avis Executive Proactanium
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #200 on: November 19, 2012, 01:33:31 PM »
Never got this one before:

"Connection Problems

Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later."
2015: 116K bkd | 1.6M brnd | F: OZ,NH,AA,EK | J: UA,CA,TK,DL,TN,AF,VA | LIH,NRT,ROR,PEK,CNS,BOB,MEL,TLV & Pacific Hopper

Offline Dan

  • Administrator
  • Dansdeals Lifetime 50K Presidential Platinum Elite
  • **********
  • Join Date: May 2008
  • Posts: 55125
  • Total likes: 3128
  • DansDeals.com Hat Tips 16441
  • Gender: Male
    • View Profile
  • Location: CLE
  • Programs: UA Global Services, AA Lifetime Plat, DL Dirt, SPG Plat, Hyatt Diamond, Fairmont Lifetime Plat, Hilton Diamond, Priority Club Plat, Avis Chairman, National EE, Hertz PC
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #201 on: November 19, 2012, 01:39:48 PM »
Never got this one before:

"Connection Problems

Sorry, SMF was unable to connect to the database. This may be caused by the server being busy. Please try again later."
BAHayman hard at work is my guess :)
Save your time, I don't answer PM. Post it in the forum and a dedicated DDF'er will get back to you as soon as possible.

Offline BAHayman

  • Administrator
  • Dansdeals Lifetime Platinum Elite
  • **********
  • Join Date: Mar 2010
  • Posts: 1942
  • Total likes: 19
  • DansDeals.com Hat Tips 0
    • View Profile
Re: Re: 500 Internal Server Error/502 Bad Gateway
« Reply #202 on: November 19, 2012, 01:42:43 PM »
BAHayman hard at work is my guess :)
Yup, sorry about that one. I believe I have narrowed it down to an issue with pagination on large WordPress sites.

I'm looking into it more, but I think it's the pagination of search results.

Offline rots5

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Jul 2011
  • Posts: 8142
  • Total likes: 13
  • DansDeals.com Hat Tips 17
    • View Profile
    • Custom Cakes for Every Occassion
  • Location: Monsey
Re: Re: 500 Internal Server Error/502 Bad Gateway
« Reply #203 on: November 19, 2012, 01:55:22 PM »
Yup, sorry about that one. I believe I have narrowed it down to an issue with pagination on large WordPress sites.

I'm looking into it more, but I think it's the pagination of search results.

Dont u think its time we switch over to a custom site?
If you have any questions please search and then ask. PM me for detailed help.

Online AsherO

  • Global Moderator
  • Dansdeals Lifetime 20K Presidential Platinum Elite
  • **********
  • Join Date: May 2008
  • Posts: 20772
  • Total likes: 181
  • DansDeals.com Hat Tips 74
    • View Profile
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #204 on: November 19, 2012, 02:13:39 PM »
Yup, sorry about that one. I believe I have narrowed it down to an issue with pagination on large WordPress sites.

I'm looking into it more, but I think it's the pagination of search results.

So it's a DD issue and not a DDF issue? Maybe we can change how the DD search works (by using a wordpress plugin or something).

By we I mean you :)
PGF24BMGS

Offline rots5

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Jul 2011
  • Posts: 8142
  • Total likes: 13
  • DansDeals.com Hat Tips 17
    • View Profile
    • Custom Cakes for Every Occassion
  • Location: Monsey
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #205 on: November 19, 2012, 03:13:29 PM »
So it's a DD issue and not a DDF issue? Maybe we can change how the DD search works (by using a wordpress plugin or something).

By we I mean you :)
Just got it for the first time in months on the iPhone safari browser
If you have any questions please search and then ask. PM me for detailed help.

Offline BAHayman

  • Administrator
  • Dansdeals Lifetime Platinum Elite
  • **********
  • Join Date: Mar 2010
  • Posts: 1942
  • Total likes: 19
  • DansDeals.com Hat Tips 0
    • View Profile
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #206 on: November 19, 2012, 10:01:49 PM »
Dont u think its time we switch over to a custom site?
Wordpress should be able to easily handle this kind of volume.

So it's a DD issue and not a DDF issue? Maybe we can change how the DD search works (by using a wordpress plugin or something).

By we I mean you :)
So I was on the right track, but it wasn't a search issue. It was an issue with certain proxies and bots not respecting <link rel="archive" /> and actually loading the URL.

Those pages that were linked and getting hit, had intense database queries to calculate pagination. And to further complicate hunting down the issue, it didn't always happen. It only happened once that query for the pagination was no longer in the query cache.

I am pretty sure that this was the issue and has been fixed. But I will continue reviewing the logs to be sure.

Offline jj1000

  • Administrator
  • Dansdeals Lifetime 10K Presidential Platinum Elite
  • **********
  • Join Date: Jun 2008
  • Posts: 11046
  • Total likes: 1133
  • DansDeals.com Hat Tips 8015
    • View Profile
  • Location: The value of a forum such as this one is not in that one can post a question and receive an answer, but in that the question has most likely been asked before, and the answer is available to him that will but only use the search function.
  • Programs: 1. Search on google. 2. Search in the right board of DDF with a general word or two. 3. Read the wiki. 4. Read the thread. 5. Ask away.
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #207 on: November 19, 2012, 10:09:53 PM »
Wordpress should be able to easily handle this kind of volume.
So I was on the right track, but it wasn't a search issue. It was an issue with certain proxies and bots not respecting <link rel="archive" /> and actually loading the URL.

Those pages that were linked and getting hit, had intense database queries to calculate pagination. And to further complicate hunting down the issue, it didn't always happen. It only happened once that query for the pagination was no longer in the query cache.

I am pretty sure that this was the issue and has been fixed. But I will continue reviewing the logs to be sure.
WOW! Your amazing. Thank you!!!
See my 5 step program to your left <--

(Real signature under my location)

Offline myb821

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Mar 2011
  • Posts: 7413
  • Total likes: 1
  • DansDeals.com Hat Tips 2
    • View Profile
  • Location: New York
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #208 on: November 19, 2012, 10:10:22 PM »
WOW! Your amazing. Thank you!!!
+1000

Offline Saver2000

  • Dansdeals Lifetime Presidential Platinum Elite
  • *********
  • Join Date: Apr 2011
  • Posts: 7529
  • Total likes: 12
  • DansDeals.com Hat Tips 0
    • View Profile
Re: 500 Internal Server Error/502 Bad Gateway
« Reply #209 on: November 19, 2012, 10:12:58 PM »