Return to Jive Software

This Question is Possibly Answered

1 "correct" answer available (4 pts) 1 "helpful" answer available (2 pts)
8,387 Views 38 Replies Last post: Oct 29, 2009 2:47 PM by Karl Cyr RSS
Jochem van Dieten Novice 204 posts since
May 6, 2009
Currently Being Moderated

Jun 30, 2009 1:33 PM

Email to Clearspace bounces after 5 days

When I reply by email to a hosted Clearspace instance the message gets delivered fine to the Jive mail gateway, and then disappears, only to reappear as a bounce after 5 days. The latest email message that went missing was delivered to the mail gateway with the following log line:

Jun 27 01:30:48 smtp1 postfix/smtp[12010]: C8321F00481: to=<clearspace-113556920-5552-2-2066133@mail.forums.adobe.com>, relay=mail.sgaur.hosted.jivesoftware.com[209.46.39.252], delay=2, status=sent (250 2.0.0 Ok: queued as E092D2408550)

Times in GMT + 0200

This message still hasn't shown up in the forum. I expect to get a bounce in 2 days or so.

 

 

 

On previous bouncs the NDN read:

Reporting-MTA: dns; mail.sgaur.hosted.jivesoftware.com
X-Postfix-Queue-ID: 7418F24087B0
X-Postfix-Sender: rfc822; spam@vandieten.net
Arrival-Date: Mon, 15 Jun 2009 13:45:00 -0600 (MDT)

Final-Recipient: rfc822; clearspace-1668662174-1ry-2-7VUV@mail.forums.adobe.com
Original-Recipient: rfc822;clearspace-1668662174-1ry-2-7VUV@mail.forums.adobe.com
Action: failed
Status: 4.4.2
Diagnostic-Code: X-Postfix; lost connection with 10.137.24.42[10.137.24.42]
    while sending RCPT TO

 

Reporting-MTA: dns; mail.sgaur.hosted.jivesoftware.com
X-Postfix-Queue-ID: C13D22408391
X-Postfix-Sender: rfc822; spam@vandieten.net
Arrival-Date: Thu, 11 Jun 2009 12:34:50 -0600 (MDT)

Final-Recipient: rfc822; clearspace-1789239401-1ry-2-8eU1@mail.forums.adobe.com
Original-Recipient: rfc822;clearspace-1789239401-1ry-2-8eU1@mail.forums.adobe.com
Action: failed
Status: 4.4.2
Diagnostic-Code: X-Postfix; delivery temporarily suspended: lost connection
    with 10.137.24.42[10.137.24.42] while sending end of data -- message may be
    sent more than once
Expert 3,518 posts since
Jun 18, 2009
Currently Being Moderated
Jun 30, 2009 3:55 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Jochem,

 

I've forwarded this to our hosting team. They will look in to it.

 

Cheers,

Brad

Expert 3,518 posts since
Jun 18, 2009
Currently Being Moderated
Jul 1, 2009 11:34 AM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hey Jochem,

 

Can you please try taking this through Adobe's support team? Adding this to their list will go a long way to improving the overall system. Likewise we would need Adobe's permission to modify settings on their system no matter how minute they might seem.

 

Thanks,

Brad

Tyler Walden Jive Support Engineer 2,013 posts since
Apr 14, 2008
Currently Being Moderated
Jul 1, 2009 3:01 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Seems like a reasonable request, queue max lifetime set to 2 days.

As far as I am aware this was never suggested from Adobe.

Tyler Walden Jive Support Engineer 2,013 posts since
Apr 14, 2008
Currently Being Moderated
Aug 11, 2009 1:19 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days
A fix for this issue is currently being tested in the UAT environment and should be applied to Adobe production as soon as it is approved.
Tyler Walden Jive Support Engineer 2,013 posts since
Apr 14, 2008
Currently Being Moderated
Aug 11, 2009 2:41 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days
Yes, we believe it will fix the issue where multiple posts are made from the same message.
Tyler Walden Jive Support Engineer 2,013 posts since
Apr 14, 2008
Currently Being Moderated
Aug 12, 2009 4:39 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

I am only seeing one message currently in the queue from macromedia@vandieten.net.  Which was placed into the queue a little over an hour ago.  Do you believe you should have any messages to the UAT site that did not make it through?

05CF32408520     1831 Wed Aug 12 15:52:12  macromedia@vandieten.net
       (lost connection with 10.137.24.42[10.137.24.42] while sending RCPT TO)
                                         clearspace-1668662174-1ry-2-7VUV@mail.forums.adobe.com

 

I do know that the plugin currently deployed in UAT has many more fixes than the JIRA bug you posted above.  I don't have the exact details but I believe various localization issues were corrected, along with upgrading the underlying smtp library.


Have you been able to reproduce similar bounce-backs from the UAT site? If so please post the bounce message here so I can investigate further in the logs.

 

The message I mentioned above is not being accepted by the Jive plugin and the connection is being closed after sending the RCPT TO.

 

The two questions here are:

 

1. Why did the plugin not accept the message in the first place?

2. Why was the connection closed?  Proper behaviour would be to return a error response code, causing and immedaite bounce back.

 

I will speak with the engineers who worked on the modificatins to the plugin and see if they believe any changes in the current plugin in UAT addresses either of these issues.

Tyler Walden Jive Support Engineer 2,013 posts since
Apr 14, 2008
Currently Being Moderated
Aug 13, 2009 9:10 AM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

It appears the new version was deployed on tuesday evening.

I have asked the engineers who were working on the advanced email plugin modifications to chime in on this thread as there is still an issue.

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Aug 26, 2009 5:02 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

Thanks for your detailed troubleshooting on this issue. I'll confer with Tyler and take a deeper look into this case early next week.

 

Regards,
Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Sep 29, 2009 4:52 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

I am blocking off some time this week to look into your issue.

 

Regards,
Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 5, 2009 5:28 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Okay Jochem, I have been looking into this case. A few things to get us started:

 

  • The only record I found relating to this issue was raised from this case: http://forums.adobe.com/message/2097454#2097454. Unfortunately, the case reporter did not follow up past our initial inquiry so we weren't able to further troubleshoot.
  • Are you still seeing this problem occur frequently? Are there multiple users reporting this problem? I have seen some similar errors appearing in the mail logs over the past week, but there really isn't any way to tell that it isn't simply a matter of a misconfiguration, such as a user's outgoing email address not matching the address associated with their Clearspace user account.
  • Are there any other error codes associated with the bounce or is it always the same 4.4.2 message?
  • Have you observed any consistent scenarios for reproducing this behavior?
Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 6, 2009 2:56 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

There are some specific messages that replying to will produce this

problem

 

Can you provide me with an example or two of a specific message which has this issue?

 

I am analyzing our mail logs for details about the frequency of the error, and any other patterns which may give us some clues about why this happens.

 

Regards,

Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 13, 2009 12:37 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

In older mail logs from before the plugin was updated, I see a lot of entries like this:

 

maillog.0624:Jun 24 14:58:49 sgaurmgmt01p postfix/qmgr[21718]: 9035B2408732: removed
maillog.0624-0626:Jun 24 14:38:28 sgaurmgmt01p postfix/smtpd[25030]: 9035B2408732: client=smtp1.prisma-it.com[93.188.252.11]
maillog.0624-0626:Jun 24 14:38:28 sgaurmgmt01p postfix/cleanup[4026]: 9035B2408732: message-id=<4A428EBE.3080703@email.com>
maillog.0624-0626:Jun 24 14:38:28 sgaurmgmt01p postfix/qmgr[21718]: 9035B2408732: from=<your@email.com>, size=2118, nrcpt=1 (queue active)
maillog.0624-0626:Jun 24 14:38:28 sgaurmgmt01p postfix/qmgr[21718]: 9035B2408732: to=<clearspace-331453137-5552-2-2061806@mail.forums.adobe.com>, relay=none, delay=0.15, delays=0.15/0/0/0, dsn=4.4.2, status=deferred (delivery temporarily suspended: lost connection with 10.137.24.42[10.137.24.42] while sending end of data -- message may be sent more than once)
maillog.0624-0626:Jun 24 14:58:48 sgaurmgmt01p postfix/qmgr[21718]: 9035B2408732: from=<your@email.com>, size=2118, nrcpt=1 (queue active)
maillog.0624-0626:Jun 24 14:58:49 sgaurmgmt01p postfix/smtp[4239]: 9035B2408732: to=<clearspace-331453137-5552-2-2061806@mail.forums.adobe.com>, relay=10.137.24.42[10.137.24.42]:2500, delay=1221, delays=1220/0/0.02/0.79, dsn=2.0.0, status=sent (250 Ok)

 

However, I do not see any such errors in recent logs (from the past few weeks). It appears that all emails which arrive at the server from your email address are going to the proper place in a timely manner.

 

Here is what is interesting:

 

Oct 11 05:44:56 sgaurmgmt01p postfix/smtpd[24013]: 5B3D72408457: client=ns21.supremeservers.co.uk[91.192.193.32]
Oct 11 05:44:57 sgaurmgmt01p postfix/cleanup[24011]: 5B3D72408457: message-id=<20091011124443.smdv2a7aos8kk0oo@webmail.my-mail2u.com>
Oct 11 05:44:57 sgaurmgmt01p postfix/qmgr[13493]: 5B3D72408457: from=<attorney@my-mail2u.com>, size=3341, nrcpt=3 (queue active)
Oct 11 05:44:57 sgaurmgmt01p postfix/smtp[8561]: 5B3D72408457: to=<clearspace-113556920-5552-2-2066133@mail.forums.adobe.com>, relay=10.137.24.42[10.137.24.42]:2500, delay=1.3, delays=0.97/0/0/0.37, dsn=5.0.0, status=bounced (host 10.137.24.42[10.137.24.42] said: 553 <clearspace-113556920-5552-2-2066133@mail.forums.adobe.com> address unknown. (in reply to RCPT TO command))
Oct 11 05:44:57 sgaurmgmt01p postfix/smtp[8561]: 5B3D72408457: to=<clearspace-1668662174-1ry-2-7VUV@mail.forums.adobe.com>, relay=10.137.24.42[10.137.24.42]:2500, delay=1.5, delays=0.97/0/0/0.55, dsn=5.0.0, status=bounced (host 10.137.24.42[10.137.24.42] said: 553 <clearspace-1668662174-1ry-2-7VUV@mail.forums.adobe.com> address unknown. (in reply to RCPT TO command))
Oct 11 05:44:57 sgaurmgmt01p postfix/smtp[8561]: 5B3D72408457: to=<clearspace-1789239401-1ry-2-8eU1@mail.forums.adobe.com>, relay=10.137.24.42[10.137.24.42]:2500, delay=1.7, delays=0.97/0/0/0.71, dsn=5.0.0, status=bounced (host 10.137.24.42[10.137.24.42] said: 553 <clearspace-1789239401-1ry-2-8eU1@mail.forums.adobe.com> address unknown. (in reply to RCPT TO command))
Oct 11 05:44:57 sgaurmgmt01p postfix/bounce[11054]: 5B3D72408457: sender non-delivery notification: DA6ED24085E4
Oct 11 05:44:57 sgaurmgmt01p postfix/qmgr[13493]: 5B3D72408457: removed

 

It appears as though a spam account is attempting to send messages to the system using your token.

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 15, 2009 6:08 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

In reply to your email:

Tokens expire? I could have sworn I have read every piece of
documentation there is on AdvancedEmail, but nowhere does it say that
tokens expire. Where is this documented? Can this be configured? How are
users supposed to know that tokens expire when they get an "address
unknown" error?

 

The email token is actually part of the core product, and is used for the Email Monitor functionality. Since the AEP is essentially an extension of the Email Monitor functionality, it borrows the email token functionality from the core code base. By default, tokens expire after seven days.

 

It does seem as though there may be an issue with the AEP here, since an email that is delivered to an address with an expired token should be outright rejected immediately, rather than being kicked around the mail queue until the timeout. It is also possible to extend the timeout value, if necessary.

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 16, 2009 6:16 AM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

So do I need to resend it or did you grab it from the queue for debugging?

I have all the information I need for debugging now. From the evidence I have seen, it looks like the messages are bouncing as a result of the expired email tokens. If you do see any messages bounce for any other reason, please let me know.

 

So is there any documentation that we can reference in our FAQ for this functionality?

I could not find any documentation on this functionality, though I am happy to answer any questions you may have.

 

And are users really supposed to get an "address unknown" error, because here I am getting a "token expired" error?

Without having researched this yet, it sounds like a bug in the plugin. If the email tokens are expired, the plugin should be rejecting the messages immediately and the sender should receive a 5xx bounce message. While an "address unknown" error might technically be correct, because the token is used to generate the recipient address, it is not descriptive and leads to the type of confusion we've seen here.

 

There is also the option of extending the mail timeouts beyond 7 days.

 

My recommendation would be to bring this up to John C. or another Adobe employee who has the ability to file a support case in Adobe's private space. For procedural reasons, I cannot take either of these actions (fixing the plugin or changing the timeout) without a customer submitted support ticket.

 

Regards,
Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 20, 2009 8:57 AM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

I agree about the documentation on the email tokens. I have created a feature request with the doc team to have this added to future documentation.

 

As for the other issues with the plugin and the configuration, these requests will need to be routed through the Adobe team.

 

Regards,
Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 29, 2009 1:49 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

Hi Jochem,

 

We were finally able to track down the exact nature of the issue.

 

When the plugin was upgraded to fix the repeating messages issue, the change included a fix for a problem which caused some emails from certain email clients to fail to be processed correctly. The fix for the issue was to move from the base62 encoded address string format like:

 

clearspace-123451231979-1ry-2-7UV

 

to an integer string format like:

 

clearspace-123451231979-5552-2-10293

 

The problem we found is that the code tries to parse the string value '1ry' into an Integer object, which will of course fail. The plugin throws an exception, and immediately stops processing the mail message without logging anything or returning a mail error code. The relay server assumes that the connection was severed for an unknown reason, and holds on to the message to retry delivery. This cycle continues until the delivery timeout threshold is reached, and then the relay server gives up.

 

What should happen is that the exception is caught, and a bounce message is delivered immediately. I have modified the code to fix this error. In the case of this particular message, it would not matter much; even if the address was processed successfully, the email would not be delivered because the token is expired.

 

Regards,

Karl

Karl Cyr Jive Employee 6,819 posts since
Mar 12, 2008
Currently Being Moderated
Oct 29, 2009 2:47 PM in response to: Jochem van Dieten
Re: Email to Clearspace bounces after 5 days

I am holding off the final verdict on this until this fix has gone into

production. Judging by my archives I ran into this problem even before

the update which switched from encoded to plain went in production last

August.

If you can provide an example of this happening with an address string which does not contain invalid characters, I will investigate.

 

Which is the next problem: people are getting an "address unknown" error

instead of a "token expired" error. Is it clear yet what is causing that

one?

This is how we have chosen to implement the plugin. The error message is technically correct, just not the most helpful. I will see if this is an easy change to make, and commit it to the plugin. However, it will be Adobe's decision to choose to update the plugin or not. Given the edge-case nature of these issues, it may not be necessary.

More Like This

  • Retrieving data ...

Bookmarked By (0)

Case Product Issues

Loading Jira issues

Loading related product issues for this case
To better serve our customers we have included functionality to automatically follow up on a case after it has been idle for more than 5 days, and then auto close after an additional 3 days of inactivity. Choose No to acknowledge that this case will remain idle for longer than 5 days.
Making cases public allows other customers to learn from the solution of the case. It can also be used to gain feedback from others in the community. Ask our Support Engineers for more info, but we encourage you to make your cases public.