Hi John,

Do you know which specific day is causing the problem? It's possible that a thread or message from that day has strange content that could be breaking the SOAP request.

Hi Jochem,

I was able to request the messages and threads from the date range mentioned above with the following soap envelope:

env:Envelope xmlns:soapenv=http://schemas.xmlsoap.org/soap/envelope/ xmlns:xsd=http://www.w3.org/2001/XMLSchema xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance>
     <soapenv:Header>
          <wsse:Security xmlns:wsse="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd" soapenv:mustUnderstand="1">
               <wsse:UsernameToken xmlns:wsu="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" wsu:Id="UsernameToken-29234933">
                    <wsse:Username>*****</wsse:Username>
                    <wsse:Password Type="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-username-token-profile-1.0#PasswordText">****</wsse:Password>
               </wsse:UsernameToken>
          </wsse:Security>
     </soapenv:Header>
     <soapenv:Body>
          <getThreadsByCommunityIDAndFilter xmlns="http://jivesoftware.com/clearspace/webservices">
               <communityID xmlns="">2240</communityID>
               <filter xmlns="">
                    <modificationDateRangeMax>2009-05-09T23:00:00.000Z</modificationDateRangeMax>
                    <modificationDateRangeMin>2009-05-08T23:00:00.000Z</modificationDateRangeMin>
                    <recursive>false</recursive>
                    <sortField>9</sortField>
                    <sortOrder>0</sortOrder>
                    <startIndex>0</startIndex>
               </filter>
          </getThreadsByCommunityIDAndFilter>
     </soapenv:Body>
</soapenv:Envelope>

I was able to retrieve all of the threads from the requested time frame. I suspect you may be missing some of the required filter elements such as sortField, sortIndex, and startIndex.

Sean Moran wrote on 7/23/2009 8:49 PM:

I was able to retrieve all of the threads from the requested time frame. I suspect you may be missing some of the required filter elements such as sortField, sortIndex, and startIndex.

Adding those fields doesn't help. The WireShark trace of my message is:

   POST /rpc/soap/ForumService HTTP/1.1\r\n

        Expert Info (Chat/Sequence): POST /rpc/soap/ForumService HTTP/1.1\r\n

            Message: POST /rpc/soap/ForumService HTTP/1.1\r\n

            Severity level: Chat

            Group: Sequence

        Request Method: POST

        Request URI: /rpc/soap/ForumService

        Request Version: HTTP/1.1

    Referer: app:/ForumClient.swf\r\n

    truncated Accept: text/xml, application/xml, application/xhtml+xml, text/html;q=0.9, text/plain;q=0.8, text/css, image/png, image/jpeg, image/gif;q=0.8, application/x-shockwave-flash, video/mp4;q=0.9, flv-application/octet-stream;q=0.8,

    x-flash-version: 10,0,12,36\r\n

    Content-Type: text/xml; charset=utf-8\r\n

    SOAPAction: ""\r\n

    Content-Length: 753\r\n

        Content length: 753

    User-Agent: Mozilla/5.0 (Windows; U; en-US) AppleWebKit/526.9+ (KHTML, like Gecko) AdobeAIR/1.5\r\n

    Host: forums.adobe.com\r\n

    Connection: Keep-Alive\r\n

    truncated Cookie: s_vi=[CS]v1|4A678FFE00003604-A02082900000175[CE]; ach-locale=en_US; AUID=4sAMcMBBp%2BShQEd6LY4ICih2aSpCmtWSk8KpTTxq3sPdQwNBQLnn76vqOXbJQ%2FuSV3oL1IxncphL%0ArMx1nHomSA%3D%3D; WCDServer=sessionIDvsTaLj48RXz9J6ish11nuMap

    \r\n

eXtensible Markup Language

    <SOAP-ENV:Envelope>

        xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"

        xmlns:xs="http://www.w3.org/2001/XMLSchema"

        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"

        <SOAP-ENV:Body>

            <tns:getMessagesByCommunityIDAndFilter>

                xmlns:tns="http://jivesoftware.com/clearspace/webservices"

                <communityID>

                    2240

                    </communityID>

                <filter>

                    <modificationDateRangeMax>

                        2009-05-09T22:00:00Z

                        </modificationDateRangeMax>

                    <modificationDateRangeMin>

                        2009-05-08T22:00:00Z

                        </modificationDateRangeMin>

                    <recursive>

                        false

                        </recursive>

                    <sortField>

                        9

                        </sortField>

                    <sortOrder>

                        0

                        </sortOrder>

                    <startIndex>

                        0

                        </startIndex>

                    </filter>

                </tns:getMessagesByCommunityIDAndFilter>

            </SOAP-ENV:Body>

        </SOAP-ENV:Envelope>

And the response from the forums:

    HTTP/1.1 500 Internal Server Error\r\n

        Expert Info (Chat/Sequence): HTTP/1.1 500 Internal Server Error\r\n

            Message: HTTP/1.1 500 Internal Server Error\r\n

            Severity level: Chat

            Group: Sequence

        Request Version: HTTP/1.1

        Response Code: 500

    Date: Fri, 24 Jul 2009 09:47:27 GMT\r\n

    Content-Type: text/xml;charset=UTF-8\r\n

    Content-Length: 227\r\n

        Content length: 227

    Vary: Accept-Encoding,User-Agent\r\n

    JP: D=398571 t=1248428847867662\r\n

    Connection: close\r\n

    \r\n

eXtensible Markup Language

    <soap:Envelope>

        xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/"

        <soap:Body>

            <soap:Fault>

                <faultcode>

                    soap:Server

                    </faultcode>

                <faultstring>

                    Fault occurred while processing.

                    </faultstring>

                </soap:Fault>

            </soap:Body>

        </soap:Envelope>

I also noticed you are using WSSE to log in. Are you testing this

against some internal server or with some internal account? According to

the info I got WSSE is not working with the Adobe ID accounts.

--

Jochem van Dieten

http://jochem.vandieten.net/

Sean Moran wrote on 7/25/2009 1:36 AM:

I'm not sure how you're retrieving any other records as anonymos access to the web services is not allowed, as defined in the admin console.

I think I have had this discussion before:

http://www.jivesoftware.com/jivespace/message/233013#233013

Jochem

--

Jochem van Dieten

http://jochem.vandieten.net/

And another one

Hey Jochem,

I'm still able to make the same request and get results without error. I'm going to create a test user with your permissions to see if that's where the issue lies.

Hi Jochem,

I was using WSSE, but I'm now using an Adobe ID. I am still unable to receive the error. Using a Adobe ID and your soap request I'm able to retrieve the contents without issue.

Hi Jochem,

I'm using an Unprivleged Adobe ID we use for monitoring. Using your soap request I'm not getting an error. I am, however, getting an empty set, as there are no threads in that community for the selected timeframe:

POST /rpc/soap/ForumService HTTP/1.1

Host: forums.adobe.com

User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.0.11) Gecko/2009073121 Gentoo Firefox/3.0.11

Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8

Accept-Language: en-us,en;q=0.5

Accept-Encoding: gzip,deflate

Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7

Keep-Alive: 300

Content-Type: application/x-www-form-urlencoded; charset=UTF-8

Content-Length: 719

Cookie: s_vi=[CS]v1|253BAE11050116A8-6000010040005AD7[CE]; jive.recentHistory=312c38353532373b; Foresee_ABXTesting=null; currentURL=blank; s_cc=true; s_sq=%5B%5BB%5D%5D; ach-locale=en_US; IOND=OEUGL9nbyK/kPxY23TCvGIfcqbc=; previousURL=https%3A//www.adobe.com/cfusion/entitlement/index.cfm%3Fe%3Dca%26returnurl%3Dhttp%3A//forums.adobe.com/login.jspa%26loc%3Den; JSESSIONID=9E8DCEFB95BAF556F6FF75CFB62A9C0D.node0; jive.server.info="serverName=forums.adobe.com:serverPort=80:contextPath=:localName=127.0.0.1:localPort=7000:localAddr=null"; BIGipServerPool_53_ENT2=706251018.22555.0000; SCREENNAME=jivehosting; WCDServer=sessionID*zgwa9A3qTuLSD5gKmRQlcM*appNum*60*appHost*marlins; DMEMB=user&107778267&roles&none&ip&70.98.39.250&hash&1a2fc9a53cd8694c1fbd629b29727201; AUID=CGN9T0QOiHZDRvrJD6p%2FcnRqu6gvMBHXPG2O%2F2teVWC6BXlRFkiykl6Rig%2FlR4odvqS8nkpWqG3k%0AxLbkmUF%2F1A%3D%3D; jive.user.loggedIn=true

Pragma: no-cache

Cache-Control: no-cache



<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<soapenv:Header>
</soapenv:Header>
<soapenv:Body>
<getThreadsByCommunityIDAndFilter xmlns="http://jivesoftware.com/clearspace/webservices">
<communityID xmlns="">3263</communityID>
<filter xmlns="">
<modificationDateRangeMax>2008-04-01T18:00:00.000Z</modificationDateRangeMax>
<modificationDateRangeMin>2008-03-31T18:00:00.000Z</modificationDateRangeMin>
<recursive>false</recursive>
<sortField>9</sortField>
<sortOrder>0</sortOrder>
<startIndex>0</startIndex>
</filter>
</getThreadsByCommunityIDAndFilter>
</soapenv:Body>
</soapenv:Envelope>

HTTP/1.1 200 OK

Date: Thu, 20 Aug 2009 22:27:13 GMT

SOAPAction: ""

Content-Type: text/xml;charset=UTF-8

Vary: Accept-Encoding,User-Agent

Content-Encoding: gzip

JP: D=219282 t=1250807233439006

Content-Length: 174



<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/">
<soap:Body>
<ns1:getThreadsByCommunityIDAndFilterResponse xmlns:ns1="http://jivesoftware.com/clearspace/webservices">
</ns1:getThreadsByCommunityIDAndFilterResponse>
</soap:Body>
</soap:Envelope>

I'm accessing the the site using the external URL which goes through the same firewalls and load balancers.

Hi Jochem,

I believe I'm finally seeing the same error. Unfortunately no information regarding the error is being logged. In order to figure out exactly what's going on I'll need to get a copy of the database running locally. This could take some time, as I'll need to transfer the db from our datacenter to my local machine and load it up.

Once I've been able to reproduce this locally with a debugger attached, I'll let you know our next steps for resolution.

The one in community 3263 works. I am still getting errors on the other messages I reported and retried. Did you only fix the one in community 3263?

I am also seeing a problem here. Most of the other occurences of this problem are from a date after the migration to ClearSpace. So the other occurences were not caused by the import, but by the ongoing use of ClearSpace. So I see no reason to presume that even when you fix the existing occurences, the problem will not occur again. So I think there is still the need for an investigation and fix of the root cause. Or at the very least some logging of the error condition so that somebody is informed the problem has (re)occured.