Re: BUG: Now I'm getting no e-mails for many forum posts

I'm still getting two e-mails for every forum post several hours a day, but now I'm missing e-mails as well. For example I haven't gotten any of the posts at
- Catholic resources that are languishing in community pricing - did you miss them?,
- Comparison of Greek texts,
- Alcuin Club Tracts (27 vols.) Don't miss out at < $2 a volume
- SUGGESTION: PCUSA worship resources
- Closing next week (I hope)
- Closing week after next if we show excellent taste in poetry/hymns.
- Forum Proliferation
- Webinar
I'm also missing the last few posts at Free Logos Webinar.
(And it had to be [mostly] MJ's threads, the ones I'm most likely to be interested in!)
Mac Pro (late 2013) OS 12.6.2
Comments
-
Also, I'm getting a "Sorry, there was a problem with your last request!" message almost every time I post, although the posts seem to go through anyway. It just takes extra time to check.
Mac Pro (late 2013) OS 12.6.2
0 -
Bump.
Mac Pro (late 2013) OS 12.6.2
0 -
fgh said:
Also, I'm getting a "Sorry, there was a problem with your last request!" message
Please see my response here: http://community.logos.com/forums/p/84956/595712.aspx#595712
0 -
fgh said:
but now I'm missing e-mails as well
I've opened a case for this issue. I will add a link to this forum post to the case so that you will be updated once it's fixed.
0 -
Thanks. I hope you realize this bug is urgent. It's not only a nuisance that wastes time I don't have when I have to read the forums on the web, what's even worse is that when I don't get the e-mails, I can't save them, which means I completely lose track of bug reports and other threads I want to keep an eye on.
OK, it's not quite as urgent as keeping the websites up and running (all Logos sites have been down for me for most of this afternoon and evening), but almost (and, of course, with the subscriptions malfunctioning, I have no way of knowing if you're even aware that all sites are down...). Certainly far too urgent for it to take nearly 24 hours to even get a reply. A bug like this should be fixed in hours, not days.
And, by the way, by now it's so bad that I don't think I get more than 1 post in 10 or so.
(Now let's see if I can post this, or if everything's down again.)
Mac Pro (late 2013) OS 12.6.2
0 -
Other than this 1 email, I haven't had any others for hours. Something is surely amiss....
Rog {BlueBird}
0 -
I am getting some emails from posts, but I just did a compare with teh Forums and there are still a number of posts that are not going out. Is this still considered a problem?
0 -
I'll be spending most of today digging into the various forum woes.
I believe the following are all outstanding issues, please let me know if I missed any.
http://community.logos.com/forums/t/62983.aspx - Missing emails
http://community.logos.com/forums/t/84184.aspx - Duplicate emails
http://community.logos.com/forums/t/84592.aspx - Slow forums performance
http://community.logos.com/forums/t/84636.aspx - Duplicate posts
http://community.logos.com/forums/t/84758.aspx - Bump of 84636
http://community.logos.com/forums/t/84927.aspx - Duplicate emails, or missing emails
http://community.logos.com/forums/t/84980.aspx - Errors posting and attaching files
http://community.logos.com/forums/t/84956.aspx - Errors posting
I disabled the secondary web server on May 21st around 4:30 pm. Some changes were also made to our outbound email servers late on the 21st.
It sounds like you're no longer getting duplicates, and just plain missing a ton of emails.
I'm seeing some connection hiccups every 14 hours or so, but those last under 10s.
Our reporting shows the average browser response time as <4 seconds, with occasional spikes above 6s. However, if there was a browser or web server-side error, it may not show up in the statistics. From the posts I'm reading it sounds like the slowness is inconsistent and affects simple to complex usage.
Also according to the reporting, Community Forums has a 195 ms app server response time, 220 requests per minute, and a 0.0175% error rate.
I'll be switching you guys over at various times today to the failover server while I tweak and look at the primary.
The forums has it's own dedicated quad-core VM with 8GB RAM on Enterprise SSDs. We're at least trying to treat you all well
I'll do my best to keep this thread updated with my findings.
0 -
I have been trying to make a new post for over an hour and I keep getting the "Sorry..." error. Yet this is my second Reply post that has gone through!
0 -
Joel Garboden said:
I'll be spending most of today digging into the various forum woes.
Thanks!
Joel Garboden said:http://community.logos.com/forums/t/62983.aspx - Missing emails
That's a 1.5 year old thread, to which I just added a new post, hoping that someone from back then was still subscribed to it and would give me a quicker response. The real, current, missing e-mails thread is this one (which you list further down).
Joel Garboden said:http://community.logos.com/forums/t/84184.aspx - Duplicate emails
Replied in that thread.
Joel Garboden said:http://community.logos.com/forums/t/84592.aspx - Slow forums performance
For me, the forums are actually very fast right now (apart from the error messages when posting).
Joel Garboden said:http://community.logos.com/forums/t/84636.aspx - Duplicate posts
http://community.logos.com/forums/t/84758.aspx - Bump of 84636
RSS posts, not forum posts.
Joel Garboden said:I believe the following are all outstanding issues, please let me know if I missed any.
You missed Logos Forum Website Error Message, but it's covered in the other threads. And my complete inability to access any Logos website or server for most of yesterday, but that seems fixed today, so hopefully it's no longer outstanding.
From my perspective, the missing e-mails are by far the most urgent. The incorrect error messages are annoying and time consuming, but at least they only affect the now; the missing e-mails will cause me problems long after you've fixed them.
I'm afraid the technical stuff is beyond me.[:)]
Joel Garboden said:I'll do my best to keep this thread updated with my findings.
Updates are always appreciated!
And thank you for the e-mail about your post. That's the most considerate gesture I can remember receiving from a Logos employee ever.
Mac Pro (late 2013) OS 12.6.2
0 -
Don,
From what I can tell, I see, between May 18 07:59:15 UTC and May 23 19:33:38 UTC, forums sent 794 messages outbound to you from our mail servers. Does this match what you actually received?
In addition, forums are now running on the failover web server, please let me know if this changes forum errors at all.
0 -
The backup server doesn't have the reporting I mentioned in my previous post, so any performance feedback would be greatly appreciated. I made the cut-over at 1:20 PM PST.
Are emails being duplicated, or just RSS?
Are you missing emails and RSS notifications?
Yesterdays outages should be all attributed by a security feature backfiring and blocking actual sites, it should have been resolved around 11am PST.
No worries about the technical stuff, I'm just trying to give as much information as I can to the people who can reproduce their issues.
I'll be upgrading the database server either late tonight or Tuesday night, which should resolve a few of the errors you've been experiencing with posting.
0 -
Fgh,
I see 777 messages outbound to your email address between May 18 07:59:15 UTC and May 23 19:33:38 UTC. How many did you actually receive?
I apologize if you're having to duplicate information, just trying to gather it all in one thread for ease of diagnosis.
0 -
-
Nope - other message still fails even without the link. Just can't send a new post.
0 -
Joel Garboden said:
Are emails being duplicated
See reply in the other thread.
Joel Garboden said:or just RSS?
The duplicated RSS posts came all at once (once for each affected feed, that is). They haven't continued with new posts. I doubt there's anything you can do about them now, other than trying to ensure it doesn't happen for your other feeds as well. It's just very annoying since I have lots of prepub feed posts that I've deliberately left 'unread' because I haven't had time to make up my mind about buying them, so I can't just mark everything as read and get rid of them. I really do have to click all 200 or so duplicates away manually, one by one.[:(] Which will give me even less time to consider new purchases.[:(] And it's annoying because it isn't exactly the first time you've done this to me. It's happened multiple times.[:(]
Joel Garboden said:Are you missing emails
Yes, I'm still missing e-mails.
Joel Garboden said:and RSS notifications?
Not that I've noticed, but with all these time consuming errors I haven't had a chance to check.
Joel Garboden said:I see 777 messages outbound to your email address between May 18 07:59:15 UTC and May 23 19:33:38 UTC. How many did you actually receive?
Is there a way to figure that out without counting them one by one?
Mac Pro (late 2013) OS 12.6.2
0 -
Thanks for the response.
I've made a few changes that should hopefully eliminate the duplicate emails and RSS at least.
I totally agree, I use unread items in my feeds/inbox to signify TODOs and the like.
It seems as if email notifications are getting out of our network, but not reaching you. It will take me a few days to try and narrow down which portion of the road is broken. I'll look into the logs I've taken, your feedback, and errors I'm seeing to try and come up with a reason.
I'll post an update on Tuesday with my findings about emails going out, I believe I solved the RSS duplication at least.
fgh said:
Joel Garboden said:I see 777 messages outbound to your email address between May 18 07:59:15 UTC and May 23 19:33:38 UTC. How many did you actually receive?
Is there a way to figure that out without counting them one by one?
I'm just hoping for a ballpark to see how many missing emails I should be looking for. Web mail or desktop email clients should give a number of emails in a particular folder, or how many are selected.
It seems like posting errors, but actually submits the post. I'm seeing some obscure errors on our end, which may be related to the database server.
Thank you for your continued responses, they've been really helpful in narrowing down where the problem might be.
0 -
fgh said:Don Awalt said:
Nope - other message still fails even without the link. Just can't send a new post.
Don, you have started 8 new threads about the Paulist prepub!
Whoa really? I didn't even look, they are all giving me this error I just posted! Plus I am not getting any of them via email. This is really broken.
0 -
Joel Garboden said:
Web mail or desktop email clients should give a number of emails in a particular folder, or how many are selected.
They should, but a) they are no longer in one folder, and b) like so many other programs, including Logos, Thunderbird has essentially stopped fixing bugs for 10.6, and one of the more annoying ones is that I no longer get any number when I select. Well, sometimes I can get one directly after restart, but only one, not for multiple folders, so getting something even remotely accurate would take multiple restarts. Plus I'd first need to figure out what UTC is. I'd prefer PST. After all this time with Logos, I know what that is.
And, by the way, for most of the time you mentioned, I got lots and lots of duplicate e-mails, so would that number really tell you anything? Surely it would be more useful to look at how many I've gotten after the duplicate e-mails ended?
Some observations:
- I seem to be getting more posts now than I did some hours ago. Or at least I did; recently it's slowed down again.
- I believe I've gotten all, or at least most, of the posts in this thread.
- I believe I've gotten all, or at least most, of the posts in the French forum (not the most important one...)
- I'm still missing virtually all posts by MJ (which, to me, are more or less the most important ones, together with those by Logos' employees and some of my own), especially threads started by her.
- I will be very disappointed if this continues until Tuesday!
Mac Pro (late 2013) OS 12.6.2
0 -
Good news: I may now be getting all posts. At least I'm getting enough to make it very hard to say if any are still missing.
Bad news: I have received two more duplicate posts. Not that I get upset over that few. I just wanted to let you know.
Mac Pro (late 2013) OS 12.6.2
0 -
fgh said:
At least I'm getting enough to make it very hard to say if any are still missing.
Unfortunately, I just discovered one post I didn't get: http://community.logos.com/forums/p/85174/597050.aspx#597050 (I got the reply, which is why I noticed).
No more duplicates.
Mac Pro (late 2013) OS 12.6.2
0 -
Another post that didn't arrive: http://community.logos.com/forums/p/85212/597324.aspx#597324.
Mac Pro (late 2013) OS 12.6.2
0 -
fgh, I've updated the case with your most recent message and let the case assignee know.
0 -
Thanks. Some more:
- http://community.logos.com/forums/p/85222/597385.aspx#597385
- http://community.logos.com/forums/p/85223/597363.aspx#597363
- http://community.logos.com/forums/p/85156/597128.aspx#597128
- http://community.logos.com/forums/p/82541/597402.aspx#597402
Does it help you if I list the exact missing posts like this, or am I just wasting time?
EDIT: Added more links.
Mac Pro (late 2013) OS 12.6.2
0 -
fgh said:
Does it help you if I list the exact missing posts
Sure. They're useful for tracking down logs.
0 -
OK, then I'll add them to this post as long as I can edit it.
Mac Pro (late 2013) OS 12.6.2
0 -
Two of the missing posts just turned up. Was that you?
Mac Pro (late 2013) OS 12.6.2
0 -
fgh said:
Two of the missing posts just turned up. Was that you?
Not I, I haven't changed anything with Forums recently. They probably got delayed somewhere along the line due to sheer volume of messages going to you.
I'm seeing significantly less errors at a server-level since my Friday/Saturday night changes.
0 -
I haven't checked line by line, but I believe I've now gotten all the missing e-mails listed above, plus quite a few more I didn't realise were missing.
Joel Garboden said:They probably got delayed somewhere along the line due to sheer volume of messages going to you.
Any idea why? It's never happened before during 3,5 years, and the volume has at times been much higher (L5 launch...).
Mac Pro (late 2013) OS 12.6.2
0 -
We've also been increasing how much email we send out (more products, more customers, more promotions, etc), we occasionally get flagged as spam by various email providers (Yahoo being most frequent). The spam block doesn't last very long, once they/we confirm it isn't actually spam. The temporary spam block might explain the "waves" you've been getting.
I don't have numbers to back that theory, but I'm sticking with it!
Thanks for your patience and feedback during this problem.
0 -
I'm missing lots of e-mails again, eg
Mac Pro (late 2013) OS 12.6.2
0 -
And I am getting doubles of almost every post! Arrrrgggghhh! Been that way since at least late last week. No replies from Logos on this.
0 -
0
-
Don Awalt said:
And I am getting doubles of almost every post! Arrrrgggghhh! Been that way since at least late last week. No replies from Logos on this.
Don, we have a case open for this as well.
0 -
fgh said:
I'm missing lots of e-mails again
Thanks, fgh....I was beginning to wonder because the quantity in my inbox has dropped significantly lately, but hadn't had the time to check it out. This is my preferred way to monitor the forum, cause I don't miss any conversations this way (when it is working!). Hopefully it will get fixed soon.
0 -
Toby, in the last 15 hours, I've gotten exactly 14 e-mails. I would imagine that the correct number should be well above 100.
Mac Pro (late 2013) OS 12.6.2
0 -
Hi, all. We're still working on correcting the e-mail issues. I'm sorry I don't have an ETA yet to share. Thanks for your patience.
0 -
Toby,
With email not working I tried to review posts I made to check responses by looking at my forum activity. However my activity is not appearing when I click the link. I checked some other users. Graham Kiddle has his activity listed. Dave Hooten does not. Is there a setting somewhere I am missing?
Windows 7, Nexus 7
0 -
My apologies for the delayed resolution.
I rewrote the entire email sending code, which I'd been wanting to do anyway... just not in an evening and with things on fire.
I archived the 5000 queued emails from the 9/15 10am PST to 9/17 2PM PST; but am sending the ~1200 emails from 9/17 2PM- most-current.
Please let me know if there are any inconsistencies in formatting, or anything different than when email notifications were working before.
I'm sure there will be kinks, but at least it's shipped!
EDIT: HTML characters in the subject should now display properly (11:30pm PST)
0 -
I'm not sure why emails stopped working, but it did coincide with my deployment on Monday morning (Avatars and error handling/logging). However, reverting to old code didn't make emails send again.
We bought the Forums SDK back in 2008 but were not given the source code for emailing, which made debugging emailing virtually impossible.
My email sender may not be ideally written, but at least queued emails should be being sent.
0 -
Thank you Joel for the nice job under duress to get this working again!
I only see two problems so far:
1, Quotes in email titles come out wrong - they show as
Re: BUG: Now I'm getting no e-mails for many forum posts
with the &#<nr> designation for the quotes. There may be other non alpha no numeric characters this happens for.
2. The title of the sender is now forums@logos.com, as is the email address. In gmail it shows just as "forums". Previously, it was the same sending email address of course but the sender was Logos Bible Software - Automated Email - which showed just as "Logos Bible Software", a friendlier name. It's much easier to detect these emails in my Inbox if they are from something other than just "forums@logos.com", kind of an unfriendly name like "forums". I would prefer Logos Bible Software Forums myself.
Thanks!
0 -
Don Awalt said:
1, Quotes in email titles come out wrong - they show as
Re: BUG: Now I'm getting no e-mails for many forum posts
with the &#<nr> designation for the quotes. There may be other non alpha no numeric characters this happens for.
I'm still working on this.
Don Awalt said:2. The title of the sender is now forums@logos.com, as is the email address. In gmail it shows just as "forums". Previously, it was the same sending email address of course but the sender was Logos Bible Software - Automated Email - which showed just as "Logos Bible Software", a friendlier name. It's much easier to detect these emails in my Inbox if they are from something other than just "forums@logos.com", kind of an unfriendly name like "forums". I would prefer Logos Bible Software Forums myself.
I had the data, just forgot to add it to the outgoing email; should be fixed now.
0 -
Don Awalt said:
1, Quotes in email titles come out wrong - they show as
Re: BUG: Now I'm getting no e-mails for many forum posts
with the &#<nr> designation for the quotes. There may be other non alpha no numeric characters this happens for.
This should now be fixed.
0 -
Thanks Jason, for the updates!
I have seen one more problem - now I am back to getting 2 emails per post - not all the time, some of the time. Better than 0 emails of course <g> but it would be nice to squash this bug...
0 -
I rewrote the entire email sending code, which I'd been wanting to do anyway... just not in an evening and with things on fire.
[:D][:S][*]
I am extremely grateful that someone has finally started doing something about the forum software. It has a large, and constantly increasing, number of very annoying and time-consuming bugs, most of which I have given up wasting time on even reporting, since no one ever did anything about them anyway. Given how much money we here must save Logos in CS costs -- several full time salaries, I would imagine -- one would think that your boss could at least give us a functional forum to work with...
I'm sure there will be kinks
There are[:)]:
1) I get e-mails that are time-stamped 13-14 hours before they actually turn up.
2) I get e-mails that are time-stamped incorrectly:
(Clearly, the question must have been posted before the replies. And the other posts weren't all written in that order either.)
3) I think there are still e-mails missing, though I'm still behind after 3 weeks abroad, and with the additional confusion of some e-mails arriving a day too late, I'm not yet absolutely sure.
It is very hard to follow threads when posts are missing, turn up a day later, or are listed in a completely random order compared to that in which they were written.[;)]
Mac Pro (late 2013) OS 12.6.2
0 -
Please let me know if there are any inconsistencies in formatting
(that's supposed to be a [:D])
(No one else could report these in the four or more weeks since I last posted??)
Mac Pro (late 2013) OS 12.6.2
0 -
And there's a new set of serious e-mail problems, see https://community.logos.com/forums/p/92332/641094.aspx#641094 and following.
Mac Pro (late 2013) OS 12.6.2
0 -
fgh said:
3) I think there are still e-mails missing, though I'm still behind after 3 weeks abroad, and with the additional confusion of some e-mails arriving a day too late, I'm not yet absolutely sure.
I am now. I never got https://community.logos.com/forums/p/92249/640590.aspx#640590. And I haven't gotten any of my own posts today.
Mac Pro (late 2013) OS 12.6.2
0