Joyent’s problems continue
Published January 17, 2008 by Robbie
I’m both a BingoDisk (online storage) and Accelerator (virtual private host) customer with Joyent. I’ve only been marginally satisfied with BingoDisk to date (WebDAV access is flaky to say the least), and my Accelerators are decent but have experienced quite a few IO problems from being on shared storage.
As of last Saturday, BingoDisk and Strongspace have been offline. This wouldn’t normally be an issue for me because I access my BingoDisk infrequently, but it just so happens that my Lenovo T60p was starting to act up. I could sense a crash was coming. Unfortunately I couldn’t upload my latest files and pictures to BingoDisk (my online backup location). I figured they would get it back up any day. Well yesterday my system crashed and I spent a whole day trying to salvage the files I could. I lost data. Of course I’m not blaming Joyent for my laptop crashing, but it really sucks that when I needed BingoDisk the most it wasn’t there for me.
It looks like the problems aren’t just limited to BingoDisk and Strongspace. While working on another issue with Joyent, I stumbled upon this:
Ouch, that means their public site (at least one of them) is also down. The reason I went to their website is because one of my Accelerators has been experiencing IO problems all day. I have two Accelerators, one for dev and one for prod. The problem is with my prod Accelerator. Joyent support suggested I optimize my app. Eh. The problem sprang up out of no where last night. iostat shows an obvious bottleneck on the storage side. I asked if this was related to all the data being restored from BingoDisk and the support guy said it was unrelated. The only option they gave me (besides optimizing my app) was to move me to another host and take 2 hours of downtime. Ugh.
To summarize:
1) BingoDisk down for almost a week
2) Accelerator experiencing IO problems and only solution is to move me to another web hosting provider.
3) Joyent’s own home page is down
Should I consider switching to another provider? Any recommendations?
This post has been viewed 5,046 times
Save to del.icio.us
|
Digg it
|
Reddit
Use S3 for backup. Can’t go wrong with Amazon’s infrastructure.
Checkout Slicehost, I’ve been with them for several months and have been very pleased.
If you are trying to recover your data, you can try SpinRite. It may seem costly, but it really does recover data. I’m not affiliated with them, other than being a happy customer. Check the testimonials and other online reviews. It’s definitely worth the money and you’ll get data back.
I’m also wondering about Joyent right now. I have lifetime packages with them and am wondering about these issues. I also have a Slicehost slice and they are GREAT.
Hope that helps.
I’m using Joyent Accelerator for a Facebook app I’m working on. Now you’ve got me worried.
If you decide to go with another host, please post and let us know who you pick.
I second the Amazon recommendation. Stuff is amazing and cheap.
Are you using S3 for personal backup?
I second Slicehost. We’ve been with them for over 6 months now and couldn’t be happier.
Hi, I am from Joyent. The issues around BingoDisk Strongspace were a beast to deal with, but I am happy to say - BingoDisk came online Friday and Strongspace will be brought back online this afternoon. All data is/was intact on both. And it is important to note BingoDisk and Strongspace outages did not affect any other solution from Joyent. Connector Collaboration Suite, Shared Hosting and the Accelerators were all ok so this was a contained issue.
Our CEO will be providing a summary on http://www.joyeur.com to explain the issue deeper along with what we are doing to prevent this from ever happening again. There will also be some form of compensation to all our customers as you were without the service.
As for the Accelerators - our main IO issue in the past has been hosting the Accelerators on NetApp’s. They can’t handle all of the IO, and we’ve got away from that by using raided pools of local disks, which you are on. All the Facebook apps and every new Accelerator is using a different storage solution now, and we are working to migrate the older Accelerators onto the new platform. We got bit by pushing technology where it wasn’t ready to go. We changed paths, we move on.
Thank you for hanging in there. We truly appreciate your business.
Cheers, Kristie
Regarding the Accelerator IO issue, I was supposedly moved to the new platform and I’m still seeing IO issues. In fact, just a month ago I was promised I’d never experience IO issues again, but sure enough this week I’ve seen them and they’ve impacted performance severely.
Robbie, have you submitted a support ticket since 12/30/07? If not, please do so. I just reviewed Ben’s response to your last ticket and it sounded like everything was sorted out.
Happy to look into it, but need more details.
New issue:
https://help.joyent.com/index.php?pg=request.check&id=132917iwtphk
Hi — I’m coming to this thread late, but am wondering how this has all turned out. I’m looking at Joyent’s offer to get started with the Accellerator free for OpenSocial developers.