AWS Secrets
brew install jq
- You will also need access to the AWS account. Ask someone from DevOps to send you an invitation.
Using SSO is the most straight forward solution. You won't need to go by yourself on your AWS account and it will open the needed url for you.
- Run the sso command for the first time
aws configure sso
SSO start URL [None]: https://island-is.awsapps.com/start
SSO Region [None]: eu-west-1
Then choose the environment of your choice. Likely to be
island-is-development01
. You will be prompted for the following:CLI default client Region [eu-west-1]: <Press Enter>
CLI default output format [json]: <Press Enter>
CLI profile name [AWSPowerUserAccess-X]: <Custom name (e.g. islandis-dev)> or <Press Enter>
This step will add the new profile to your
~/.aws/config
file. If you choose islandis-dev
as profile's name, you will see [profile islandis-dev]
in there.- Ready to use
You can now pass your profile to the
get-secrets
script.AWS_PROFILE=<profile-name> yarn get-secrets <project-name> # e.g. profile-name -> islandis-dev as seen above
Refresh your profile: The SSO credentials only lasts 8 hours, after which AWS commands start failing. You can run the following command to renew your SSO credentials.
aws sso login --profile <profile-name> # e.g. profile-name -> islandis-dev as seen above
It will open the browser, go to your AWS account to log in and will refresh your credentials and you are ready to use the AWS commands again.
Pre-configured AWS profiles: Feel free to copy and paste these to your
~/.aws/config
file:[profile islandis-dev]
sso_start_url = https://island-is.awsapps.com/start
sso_account_id = 013313053092
sso_role_name = AWSPowerUserAccess
sso_region = eu-west-1
region = eu-west-1
[profile islandis-staging]
sso_start_url = https://island-is.awsapps.com/start
sso_account_id = 261174024191
sso_role_name = Secret_Service
sso_region = eu-west-1
region = eu-west-1
[profile islandis-prod]
sso_start_url = https://island-is.awsapps.com/start
sso_account_id = 251502586493
sso_role_name = Secret_Service
sso_region = eu-west-1
region = eu-west-1
AWS Vault: You can use AWS Vault to store and access AWS credentials in your operating system's secure keystore. When requesting credentials from an expired SSO session, it will automatically open a browser window for you to log in again.
[islandis-dev]
credential_process = aws-vault exec islandis-dev --json
# ... do the same thing for your other profiles.
This method is more manual where you will need to export environments variables or change a file by yourself.
- Option 1: Set environment variables
You can copy/paste these environment variables to your terminal:
export AWS_ACCESS_KEY_ID=AWS_ACCESS_KEY_ID_EXAMPLE
export AWS_SECRET_ACCESS_KEY=AWS_SECRET_ACCESS_KEY_EXAMPLE
export AWS_SESSION_TOKEN=AWS_SESSION_TOKEN_EXAMPLE
- Option 2: Edit
~/.aws/credentials
Copy/paste the values in the
~/.aws/credentials
file.[default]
aws_access_key_id = <KEY_ID>
aws_secret_access_key = <ACCESS_KEY>
aws_session_token = <SESSION_TOKEN>
- Ready to use
In this case you won't need to pass a profile name as opposed to the SSO method.
yarn get-secrets <project-name>
Refresh your profile: The session token only lasts 1 hour, after which AWS commands start failing. You will need to log in to your AWS account and get new credentials, with one of the above methods.
You should now be able to fetch secrets for the project you need.
With SSO
AWS_PROFILE=<profile-name> yarn get-secrets <project> [options]
Without SSO
yarn get-secrets <project> [options]
Example:
yarn get-secrets api
You can verify it by opening the
.env.secret
file at the root, or inside your code using for example:const { MY_SECRET_KEY } = process.env
You can also add the
--reset
argument to the command, that will reset the .env.secret file.If you get the following error message, you will need to refresh your credentials as explained above.
An error occurred (ExpiredTokenException) when calling the GetParametersByPath operation: The security token included in the request is expired
You can run the following command and will be prompted for input.
With SSO
AWS_PROFILE=<profile-name> create-secret
Without SSO
yarn create-secret
Only alphanumeric characters,
/
and -
are allowed. The length of the secret name should be from 6-128 characters long.You will be asked for a secret name that will be added to the
/k8s/
secrets namespace, a secret value and the secret type (SecureString
or String
).➜ yarn create-secret
Secret name: /k8s/my-app/MY_APP_KEY
# Name: Ok!
# Length: Ok!
Secret value: a-very-secure-secret
# Length: Ok!
SecureString [Y/n]? # [enter] for SecureString
# SecureString selected
Add tags? [y/N]? # [enter] to skip creating tags
Example: Key=Foo,Value=Bar Key=Another,Value=Tag: # note: Key and Value are case sensitive! Create multiple tags by separating with whitespace.
Are you sure [Y/n]? # [enter] to confirm
# Creating secret....
It's recommended to use
SecureString
in most cases. However, if you need to add an email address, or an email sender's name to the secrets, you can just use a String
.Note that this command only creates the secret in one AWS account at a time (eg
island-is-development01
). To create a secret in all environments, you need to run it with each corresponding AWS account configured, by going through the steps in Using AWS session multiple times.To make this easier we recommend configuring SSO for each AWS account using a different AWS profile (islandis-dev, islandis-staging, islandis-prod). Then you can create a secret in all environments like this:
# If your SSO session is expired and you're not using AWS Vault, you can log into any one profile since they all share the same SSO session.
AWS_PROFILE=islandis-dev aws sso login
AWS_PROFILE=islandis-dev yarn create-secret
AWS_PROFILE=islandis-staging yarn create-secret
AWS_PROFILE=islandis-prod yarn create-secret
In order to use the secrets in your app you need to add it to its
infra
configuration.- 1.Add the new secret to
your-app/infra/your-app.ts
- 2.Generate helm charts for your app with
yarn charts islandis
- 3.
Environment variables that should not be tracked but needed locally should be added to the
.env.secret
file. (NOTE: Each variable must be prefixed with export
for direnv to pick them up.)Additionally, you can fetch secrets configured in a project's infra DSL from the
island-is-development01
AWS Parameter Store. Just run yarn get-secrets <project>
and they'll be loaded into your .env.secret
file.Last modified 1mo ago