Return to Jive Software

Up to Discussions in Developers
2,302 Views 25 Replies Last post: Dec 10, 2008 3:58 PM by Todd West RSS
dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated

Dec 2, 2008 11:48 AM

Attachments or uploaded documents removed

After the upgrade, almost all of our uploaded documents  (Word, Excel, etc.) are gone. After the description of each document, you only see the following:

 

#()

Download

 

The 'Download' link takes you to /clearspace/docs/. We are missing about 300 uploaded files and need to have this resolved as soon as possible. We recently upgraded Clearspace from 2.0.4 to 2.5.4 on 11/28/2008.

Attachments:
Tags: clearspace, 2.5.4
Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 2, 2008 12:34 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

Do you have a backup of all of your data from before the upgrade? Did you try running this on a testing server first before upgrading in production? Are you running MySQL as your database?

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 2, 2008 12:56 PM in response to: Todd West
Re: Attachments or uploaded documents removed

Yes, we have a backup but our users have created new documents since the upgrade, last Friday. During our tests, we did not notice the bad uploaded documents. We are using MSSQL 2005.

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 2, 2008 12:59 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Would you please provide me with a few rows from each of the following tables (preferably a working and non-working row):

 

jiveDocument

jiveDocumentBody

 

 

Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 2, 2008 1:37 PM in response to: Todd West
Re: Attachments or uploaded documents removed

jiveDocument:

 

Bad

 

 

23342006DOC-233411122477383581021834527040000000-121NULL1142076
23352006DOC-233511122477454561221834527040000000-121NULL1142076
23362006DOC-233611122477476429521834527040000000-121NULL1142076
23372006DOC-233711122477488372321834527040000000-121NULL1142076


 

Good

 

 

24942167DOC-249411122823759544621834527040000000-121NULL1142226
24952167DOC-249513122824147229821834527040000000-121NULL1142226
24962024DOC-249611122824689788421834527040000000-121NULL1142226
24972024DOC-249711122824830987521834527040000000-121NULL1142226


 

Todd, I have no idea how to determine what the bodyids are for the bad docs.

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 2, 2008 1:57 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

Here is how you can get the results from the jivedocumentbody table:

 

Take these ids:

 

2334

2335

2336

2337

 

SELECT bodyid FROM jivedocbodyversion WHERE internaldocid = idsListedAbove

 

Then you can use these body id's to get data from the jivedocumentbody table. In this case I will not need the results of the bodyText or bodyData column (they are very large), I just need to know if they are empty or not. Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 2, 2008 2:06 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Example of docid: 2334

 

 

4781NULLYourTipSheetforOffice 2007.pdf376339application/pdf<Binary data>1224774457498


Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 2, 2008 2:10 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

If you try to download that binary data directly from the table and save it as that file type can you view it? I know many gui tools will allow you to download binary columns directly to a file so you can test this out. If all of the data is there then that is a good sign.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 2, 2008 2:18 PM in response to: Todd West
Re: Attachments or uploaded documents removed

What gui tools do you recommend?

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 2, 2008 2:57 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

I do not use MSSQL personally so I don't really have any gui tools to recommend, MS SQL Maestro is pretty good from what I hear but I don't have any experience with it. It should be possible to view the BLOB column that contains this data using this tool. Please let me know if this works. Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 9:10 AM in response to: Todd West
Re: Attachments or uploaded documents removed

Okay. I ran the MS SQL Maestro utility and was able to view the binary data in hex, text, image, and html. I was even successful in saving the hex as the original file type (MS Word) and the file opened with format and data in tact. Now what?

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 3, 2008 9:47 AM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

How large is this database? Would it be possible to get a copy so that I can test this locally? It is a good sign that all of the data is there but I am really confused as to why it would not be showing the file name, size, etc at all. Do you have any customizations on this instance? Themes, code changes, etc?

 

Also, would you please attach a copy of your logs from the <jiveHome>/logs/ directory? If the system is having trouble loading the documents this should give some better information. Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 9:55 AM in response to: Todd West
Re: Attachments or uploaded documents removed

My backup (Clearspace.bak) is 651 MB. How should I forward it to you? I've compressed all of the log files in a [logs.zip] zipped file and attached to this message. We have no custom themes enabled and have not made any changes to the Clearspace code.

Attachments:
Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 3, 2008 10:29 AM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

None of the logs you sent me have been updated since Nov 28th. Do you have the clearspace.log file from your new 2.5 instance? This is the log file that I would need to see here. Also, I will private message you details for getting me your database dump since this case is marked public. Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 11:24 AM in response to: Todd West
Re: Attachments or uploaded documents removed

Sorry about that. Here are the log files.

Attachments:
dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 12:13 PM in response to: Todd West
Re: Attachments or uploaded documents removed

Todd,

I'm getting the following error:

 

Could not retrieve directory listing
Permission denied.

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 3, 2008 12:19 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hey David,

 

I think I have figured out the problem here (thanks for the logs by the way). You need to remove this system property from your installation:

 

jive.storage.databaseModeEnabled = false

 

You likely have this set to false and the system is trying to get document bodies from the file system without even looking in the database. If you remove this it will revert back to the default mode (database mode). I believe filesystem mode was a legacy setting that really shouldn't be used anymore. Please let me know if this works for you. You will probably need to restart for this to take affect. Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 2:30 PM in response to: Todd West
Re: Attachments or uploaded documents removed

Oh, very nice! Very very nice!

 

One last question. My (System Admin) account for Clearspace authenticates (Active Directory) properly and no one else has commented about authentication. I have no problems accessing anything in the Admin Console. However, when I'm logged into the site, I am unable to access the following:

 

Connections

Profile

Projects

Groups

Blog Posts

Documents

Discussions

Tasks *(the weird thing here is that it lists the # of tasks that are overdue)

 

I have no problem browsing content or creating new content, though. If I click on my profile avatar, my display name, or any of the previous mentioned menu options (under 'My Stuff'), I get the following error:

 

An unexpected error has occurred

 

  • The specified user was not found.

 

 

 

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 3, 2008 3:03 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

That is odd, I would need to see the stack trace that gets generated when that error gets thrown to know exactly what is going on. Has this been happening before? Would this be in the log files you sent me? If not, could you send me updated logs? Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 3, 2008 3:11 PM in response to: Todd West
Re: Attachments or uploaded documents removed

This should be in the log files that I sent you. It started after the upgrade. The weird thing is that I have no problems logging in with proper access to content. I tried resyncing user data with no success.

 

-David

 

((this message was composed using a Windows Mobile devices -please excuse typos))

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 3, 2008 3:29 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

I didn't find anything in the logs that would indicate what is going on here but I have something for you to check. Would you please check your jiveUser table and check for any users that have a 'status' column set to 0.

 

-Todd

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 8, 2008 5:59 AM in response to: Todd West
Re: Attachments or uploaded documents removed

Hi David,

 

Did you happen to get a chance to check the jiveUser table as listed above? Thanks.

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 9, 2008 10:34 AM in response to: Todd West
Re: Attachments or uploaded documents removed

Todd,

Actually my account DOES have a '0' in the status column. I appear to be the only one with a '0' status too. So, what should I do now?

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 9, 2008 10:42 AM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hey,

 

Would you please try changing this status to 6 in the database and then restart the application. This should resolve the issue for you, please let me know. Thanks!

 

-Todd

dlmcduff Novice
dlmcduff
31 posts since
Nov 30, 2006
Currently Being Moderated
Dec 10, 2008 3:34 PM in response to: Todd West
Re: Attachments or uploaded documents removed

Thanks, Todd. Changing the status number resolved the problem. Any idea why the status was changed to '0' after the upgrade?

Todd West Jive Employee
Todd West
15,918 posts since
Jul 14, 2008
Currently Being Moderated
Dec 10, 2008 3:58 PM in response to: dlmcduff
Re: Attachments or uploaded documents removed

Hi David,

 

I am not sure why this is happening, but I believe a few other guys around here have seen this as well so we will have to do some more testing to determine a root cause. Thanks!

 

-Todd

More Like This

  • Retrieving data ...

Bookmarked By (0)

To better serve our customers we have included functionality to automatically follow up on a case after it has been idle for more than 5 days, and then auto close after an additional 3 days of inactivity. Choose No to acknowledge that this case will remain idle for longer than 5 days.
Making cases public allows other customers to learn from the solution of the case. It can also be used to gain feedback from others in the community. Ask our Support Engineers for more info, but we encourage you to make your cases public.