Custom cookbooks cannot be fetched from S3
Hi,
we were kind of hoping we could have our cookbooks fetched from S3 instead of from Github. The UI allows us to choose "S3" as cookbooks URL, but all we get during instance setup is
unsupported SCM type "s3"
Given the history of checkout.rb, it seems like there never was an option for S3!
Is the ability to download the cookbooks from S3 a planned feature? We'd be really eager to see that!
Thanks,
André
Comments are currently closed for this discussion. You can start a new one.
2 Posted by kristian.hanekamp on 26 Apr, 2012 03:51 PM
Let me expand on the reasons for our wish to deploy the cookbooks from S3:
1) Stability: S3 has better availability than Github. We've seen instances that failed to start because of a Github outage.
2) Flexibility: We would like to have all source code for our systems in a single repository, including the cookbooks. But currently we cannot easily do this as Scalarium needs the cookbooks to be top-level in a separate repository.
3) Speed: As the size and history of our cookbook repository grows, so does the startup time of our instances.
To sum up: We would love to see cookbook deployment from S3.
Support Staff 3 Posted by Jonathan Weiss on 27 Apr, 2012 02:27 PM
Custom cookbook deployment off S3 is now available. Your running instances should support this within the next 24h, newly booted instances support this immediately.
Jonathan Weiss closed this discussion on 27 Apr, 2012 02:27 PM.
André Wendt re-opened this discussion on 27 Apr, 2012 02:35 PM
4 Posted by André Wendt on 27 Apr, 2012 02:35 PM
You guys are awesome, thanks!
André Wendt closed this discussion on 27 Apr, 2012 02:35 PM.
André Wendt re-opened this discussion on 27 Apr, 2012 03:00 PM
5 Posted by André Wendt on 27 Apr, 2012 03:00 PM
Hi Jonathan,
booting instances chandler and plano (c89eb26c1c6e5f620b459ae2067b151d, c89eb26c1c6e5f620b459ae206f8fea7) failed:
[Fri, 27 Apr 2012 14:54:48 +0000] DEBUG: Re-raising exception: RuntimeError - unsupported SCM type "s3" /root/scalarium-agent/cookbooks/scalarium_custom_cookbooks/recipes/checkout.rb:35:in `from_file'
And due to the missing cookbooks, I can't login to double-check :(
Seems like checkout.rb is still the old one. I can see what you did on Github though ;)
André
Support Staff 6 Posted by Jonathan Weiss on 27 Apr, 2012 03:03 PM
That is a newly created cloud right? We didn't rollout this feature globally yet, just to all Infopark accounts which is restricted to existing clouds. Every new cloud will get the default agent with the old code. We will make this the default over the next days.
I updated this new cloud to use the updated agent too, so it should work now.
7 Posted by André Wendt on 27 Apr, 2012 03:05 PM
Yeah, I just created that cloud. Gradual feature rollout FTW ;)
Thanks for the quick response. Could you please let me know when this agent is the default?
Thanks,
André
Support Staff 8 Posted by Jonathan Weiss on 27 Apr, 2012 03:13 PM
sure.
Did it work like expected?
9 Posted by André Wendt on 27 Apr, 2012 03:14 PM
It's setting up alright, thanks!
10 Posted by André Wendt on 27 Apr, 2012 03:16 PM
Spoke too soon:
Looking into
/root/scalarium-agent/site-cookbooks/gives me:Not quite right.
11 Posted by André Wendt on 27 Apr, 2012 03:21 PM
Come to think of it, the S3 URL is a presigned one for a private bucket.
I'll check with username+password instead.
12 Posted by André Wendt on 27 Apr, 2012 03:33 PM
OK, it really was the presigned URL. Everyhing works fine with AWS credentials :)
Support Staff 13 Posted by Jonathan Weiss on 27 Apr, 2012 03:35 PM
Great!
Jonathan Weiss closed this discussion on 27 Apr, 2012 03:36 PM.
André Wendt re-opened this discussion on 03 May, 2012 08:37 AM
14 Posted by André Wendt on 03 May, 2012 08:37 AM
Any updates on the status of rolling this out? We'd be happy to have this available in all our accounts for new clouds as well...
Thanks,
André
André Wendt closed this discussion on 11 May, 2012 07:16 AM.