| Configuring for Object Storage and HDFS / Configuring the Transfer Server for AWS S3 Private Cloud | |
An Aspera server with an On Demand entitlement can be configured to transfer with AWS EC2/AWS S3.
Prerequisites:
$ uname -a
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/get-set-up-for-amazon-ec2.html#create-a-key-pair
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html
# chmod 400 /filepath/user1_key.pem
If you are using a third party to access S3, you might want to verify your RSA key fingerprint when you SSH into your instance. Get the fingerprint from your machine by running the following command:
# ssh-keygen -lf /filepath/user1_key.pem
# ssh -i /filepath/private_key.pem ec2-user@public_DNS_name
If desired, confirm the RSA key fingerprint returned in the output matches that of your machine (see previous step), then enter yes. The output announces that the instance is now a known host.
Once connected, elevate to root privileges:
# sudo -i
... Port 22 Port 33001
... PasswordAuthentication yes
Save your changes.
# service sshd restart
http://downloads.asperasoft.com/downloads
If you need help with your credentials, contact your Aspera account manager. Follow the instructions in the product guide to install and set up the server.
# /opt/aspera/bin/asalee-config.sh enable # service asperanoded restart # /opt/aspera/bin/alee-admin register customer_ID entitlement_ID
# export RAILS_ENV=production # asctl faspex:rake entitlement:config_license_server EL_KEY="entitlement_id" EL_CUSTOMER_ID="customer_id"
# /opt/aspera/shares/bin/run bash -c 'cd /opt/aspera/shares/u/shares && RAILS_ENV=production bundle exec rake aspera:ami:entitlement:config_license_server EL_KEY="entitlement_id" EL_CUSTOMER_ID="customer_id"
# cd /opt/aspera/console/ # export RAILS_ENV=production # export PATH=/opt/aspera/common/ruby/bin:$PATH # rake aspera:ami:entitlement:config_license_server EL_KEY="entitlement_id" EL_CUSTOMER_ID="customer_id"
# /opt/aspera/bin/astrap-config.sh enable
# asconfigurator -x "set_user_data;user_name,username;absolute,s3://s3.amazonaws.com/my_bucket/"
Restart asperanoded to activate your changes:
# aservice asperanoded restart
$ ascp -P 33001 -T --policy=fair -l 10000 local_filepath username@gc_instance_ip_address:/
Where local_filepath is a directory on the local machine with the files you want to transfer to AWS S3. If your set up and transfer command are successful, files appear in your AWS S3 bucket .