Unablt to store archive in cloud storage in ArchiveFile

This is a discussion area for Pug, the the incremental, secure, efficient cloud file archiver that runs on Linux and stores files in cloud storage services like Amazon S3.
Post Reply
beardww
Posts: 3
Joined: Wed May 07, 2014 11:33 pm

Unablt to store archive in cloud storage in ArchiveFile

Post by beardww »

I've been wrestling with getting this working for a week or so now and would love some assistance. I run discover, the archive and this is my output:

Code: Select all

pug_archiver[3956]: Unable to upload to Amazon S3: Not Implemented at /usr/local/lib/perl5/site_perl/5.18.0/Net/Amazon/S3/Client.pm line 106.
pug_archiver[3956]: Unable to store archive in cloud storage in ArchiveFile
Any ideas where to go from here? (I've disabled iptables and reran with the same results)
I couldn't find any error logs in /var/log - any idea where they might be hiding?

CentOS 2.6.32-431.el6.x86_64
perl 5, version 18, subversion 0 (v5.18.0) built for x86_64-linux
mysql Ver 14.14 Distrib 5.1.73, for redhat-linux-gnu (x86_64) using readline 5.1
cpan /usr/local/bin/cpan version 1.61 calling Getopt::Std::getopts (version 1.07 [paranoid]),

Code: Select all

    ... snip /usr/local/lib/perl5/site_perl/5.18.0/Net/Amazon/S3/Client.pm
     76 sub _send_request_raw {
     77     my ( $self, $http_request, $filename ) = @_;
     78
     79     return $self->s3->ua->request( $http_request, $filename );
     80 }
     81
     82 sub _send_request {
     83     my ( $self, $http_request, $filename ) = @_;
     84
     85     my $http_response = $self->_send_request_raw( $http_request, $filename );
     86
     87     my $content      = $http_response->content;
     88     my $content_type = $http_response->content_type;
     89     my $code         = $http_response->code;
     90
     91     if ( is_error($code) ) {
     92         if ( $content_type eq 'application/xml' ) {
     93             my $doc = $self->s3->libxml->parse_string($content);
     94             my $xpc = XML::LibXML::XPathContext->new($doc);
     95             $xpc->registerNs( 's3',
     96                 'http://s3.amazonaws.com/doc/2006-03-01/' );
     97
     98             if ( $xpc->findnodes('/Error') ) {
     99                 my $code    = $xpc->findvalue('/Error/Code');
    100                 my $message = $xpc->findvalue('/Error/Message');
    101                 confess("$code: $message");
    102             } else {
    103                 confess status_message($code);
    104             }
    105         } else {
    106             confess status_message($code);
    107         }
    108     }
    109     return $http_response;
    110 }
User avatar
paulej
Posts: 595
Joined: Sun Aug 23, 2009 7:32 pm
Location: Research Triangle Park, NC, USA
Contact:

Re: Unablt to store archive in cloud storage in ArchiveFile

Post by paulej »

Can you point me to the exact OS release you're using? I'll try to set up a VM with that image to see why the error is occurring. I might need a few days, but I'm sure we can get it working once I can see the error for myself.
beardww
Posts: 3
Joined: Wed May 07, 2014 11:33 pm

Re: Unablt to store archive in cloud storage in ArchiveFile

Post by beardww »

CentOS-6.5-x86_64-bin-DVD1
http://isoredirect.centos.org/centos/6/ ... n-DVD1.iso
Some updates I applied to Net :: Amazon :: S3 :: Client :: Object
http://bitmuncher.subnetworx.de/2014/03 ... tamazons3/
My yum-install list (had to install some pre-req libraries to get some cpan packages to install correctly)
https://docs.google.com/document/d/17HO ... sp=sharing
beardww
Posts: 3
Joined: Wed May 07, 2014 11:33 pm

Re: Unablt to store archive in cloud storage in ArchiveFile

Post by beardww »

Also, it should be noted that I'm using SELinux w/ working Samba.
User avatar
paulej
Posts: 595
Joined: Sun Aug 23, 2009 7:32 pm
Location: Research Triangle Park, NC, USA
Contact:

Re: Unablt to store archive in cloud storage in ArchiveFile

Post by paulej »

Samba shouldn't be an issue. I would assume SELinux is also OK, though I do rather hate SELinux and do disable it immediately when I install Linux. But, I'll leave it alone for this. I'll try to test it this weekend.
User avatar
paulej
Posts: 595
Joined: Sun Aug 23, 2009 7:32 pm
Location: Research Triangle Park, NC, USA
Contact:

Re: Unablt to store archive in cloud storage in ArchiveFile

Post by paulej »

I tried to get that version of CentOS installed and working. It was painful. The OS installed, but I could not get Perl modules installed. I could not use yum for some, cpan would not work for me properly, etc. So, I just gave up. I've never encountered so many problems back-to-back like that.

That said, I am wondering if adding the [ ] is a problem. That CentOS you told me you were using has Perl 5.10. I am using Perl 5.14 and the syntax I have in the Amazon S3 related files looks like this:

Code: Select all

enum 'HTTPMethod' => qw(DELETE GET HEAD PUT);
So, I don't think deprecation is an issue. However, there is a problem with some versions of the Amazon S3 code that requires correction. In the Perl module ListBucket.pm, I had to change these lines as shown:

Code: Select all

22c22
<     foreach my $method qw(prefix delimiter max_keys marker) {
---
>     foreach my $method ( qw(prefix delimiter max_keys marker) ) {
That was the only change I had to make to the S3 Perl libraries and I've used several different versions during testing. The latest S3 code has this fix, but my libraries are a little older.

So, what happens if you do not make the changes as outlined at http://bitmuncher.subnetworx.de/2014/03 ... tamazons3/? Do you get the same or a different error?

Paul
Post Reply