- 08 Jul 2024
- 1 Minute to read
- Print
- PDF
Deployment
- Updated on 08 Jul 2024
- 1 Minute to read
- Print
- PDF
Step-by-step
Step 1: Log in to your AWS account and navigate to the AWS Marketplace.
![](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%282%29.png)
Step 2: Search for "sparkpipe" or go directly to the SparkPipe AWS Marketplace page.
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%283%29.png)
Step 3: Click on Continue to Subscribe.
![image(18).png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image(18).png)
Step 4: Click on Continue to Configuration.
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%285%29.png)
Step 5: Select the desired region and software version (latest recommended), then click on Continue to Launch.
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%286%29.png)
Step 6: Select the desired EC2 instance type, subnet settings, security group (if unsure, keep the defaults) and a pre-existing SSH key pair. Then click Launch.
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%287%29.png)
![image(19).png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image(19).png)
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%2810%29.png)
Step 7: Navigate to the EC2 dashboard of your selected region and securely access the instance using EC2 Instance Connect.
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%2811%29.png)
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%2812%29.png)
![image.png](http://cdn.document360.io/54093ab5-6b22-4542-a265-04377931f11a/Images/Documentation/image%2817%29.png)
The Configuration section will guide you on how to configure the SparkPipe service and its modules.
AWS CLI
After subscribing to the product as shown in the section above (steps 1-3), you can deploy SparkPipe using the following commands:
Create a new security group and to allow inbound SSH access :
aws ec2 create-security-group \
--group-name sparkpipe-sg \
--description "SparkPipe"
aws ec2 authorize-security-group-ingress \
--group-name sparkpipe-sg \
--protocol tcp \
--port 22 \
--cidr 0.0.0.0/0
Retrieve the latest AMI available in your region:
aws ec2 describe-images \
--owners aws-marketplace \
--filters "Name=product-code,Values=your-product-code" \
"Name=state,Values=available" \
--query 'Images | sort_by(@, &CreationDate) | [-1].ImageId' \
--output text
Launch an instance using the latest SparkPipe AMI:
aws ec2 run-instances \
--image-id <AMI_ID> \
--count 1 \
--instance-type m6g.medium \
--key-name my-key-pair \
--security-groups sparkpipe-sg
SSH into the instance using EC2 Instance Connect:
aws ec2-instance-connect ssh --instance-id <INSTANCE_ID>