Skip to content

Commit ee444a0

Browse files
authored
Merge pull request #70 from lewagon/lorcanrae/gcp-project-org-note
GCP Project org note, Ansible section wording
2 parents 7c1f093 + ab4bc29 commit ee444a0

File tree

7 files changed

+76
-48
lines changed

7 files changed

+76
-48
lines changed

β€ŽLINUX.mdβ€Ž

Lines changed: 19 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -113,6 +113,7 @@ Have you signed up to GitHub? If not, [do it right away](https://github.com/join
113113
![](images/gcp-create-project.png)
114114

115115
- Give it a name such as `Wagon Bootcamp` for example
116+
- ❗ It is important that your project **does not** have an organisation ❗
116117
- Notice the `ID` automatically created for the project, e.g. `wagon-bootcamp-123456`
117118

118119
![](images/gcp_project.png)
@@ -641,12 +642,14 @@ If you want to view your SSH configuration:
641642

642643
</details>
643644

644-
🚨🚨🚨 **The setup of your local machine is complete. All following terminal commands will be run from within your virtual machine terminal (via VS Code)** 🚨🚨🚨
645+
Congratulations, the setup of you local laptop is complete πŸŽ‰ We just need to fine tune your Virtual Machine πŸͺ›
645646

646647
---
647648

648649
# Part 2: Configure your Virtual Machine 1
649650

651+
🚨🚨🚨 **All following terminal commands will be run from within your virtual machine terminal, via VS Code** 🚨🚨🚨
652+
650653

651654
## VM gcloud and Application Default Credentials
652655

@@ -756,7 +759,7 @@ And the playbook should start running!
756759

757760
### What is the playbook installing?
758761

759-
This playbook is installing a few things, while the playbook is running, let's go through them:
762+
While this playbook is running, lets go through what is being installed and configured:
760763
- Updating system packages. Ubuntu uses the `APT` package manager.
761764
- Changing the default shell from **bash** to **zsh**, a more customizable shell that is extensible and looks great!
762765
- Installing the **Oh-My-ZSH** plugin for the **zsh** shell. We'll use it a bit later to add some quality of life plugins and extensions for `zsh`.
@@ -769,6 +772,8 @@ This playbook is installing a few things, while the playbook is running, let's g
769772

770773
The playbook is also running checks to see if things are installed or not. This is so you can safely re-run the playbook without any problems.
771774

775+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part1.yml)
776+
772777

773778
## GitHub CLI
774779

@@ -908,15 +913,9 @@ And the playbook should start running! If you're asked if you want VS Code to be
908913

909914
❗ If any errors occur, raise a ticket with a teacher. You can safely run the playbook again.
910915

911-
<details>
912-
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
913-
914-
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
915-
</details>
916-
917916
### What is the playbook installing?
918917

919-
This playbook is installing and configuring a things, while the playbook is running, let's go through them:
918+
While the playbook is running, let's go through what is being installed and configured.
920919

921920
**Python and Poetry**
922921

@@ -951,23 +950,31 @@ Ubuntu 22.04 has Python pre-installed, but not the version we're going to use. W
951950
- **gcloud**: Auto-complete for the gcloud CLI tool
952951
- **ssh-agent**: Saves your SSH password so you only have to enter it once per session.
953952
- **direnv**: A tool to load `.envrc` files when you `cd` into a directory. Great for loading environment variables.
954-
- Installing **Spark**: Spark is a distributed data processing framework
953+
- Installing **Spark**: A distributed data processing framework
955954

956955
**Data Engineering Challenges Repository**
957956

958957
The challenges that you'll be working on throughout the bootcamp! The playbook is forking the **data-engineering-challenges** repository from **lewagon** to your own GitHub user. Then cloning that repository from your GitHub account down onto your Virtual Machine.
959958

959+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part2.yml)
960+
961+
<details>
962+
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
963+
964+
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
965+
</details>
966+
960967
### Restart Virtual Machine
961968

962-
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates (specifically **pyenv** and **Docker**).
969+
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates properly (specifically **pyenv** and **Docker**).
963970

964971
To shutdown your VM, navigate to the GCP Compute Engine Instances [console page πŸ”—](https://console.cloud.google.com/compute/instances).
965972

966973
Select your VM instance and click on the stop button:
967974

968975
![](/images/gcp_vm_stop.png)
969976

970-
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console doesn't dynamically update.
977+
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console (web GUI) doesn't dynamically update.
971978

972979
When the VM is completely off, turn it on again by selecting the check box next to your instance and clicking **START/RESUME**. Give it a minute to turn on, then connect via VS Code.
973980

β€ŽWINDOWS.mdβ€Ž

Lines changed: 19 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -113,6 +113,7 @@ Have you signed up to GitHub? If not, [do it right away](https://github.com/join
113113
![](images/gcp-create-project.png)
114114

115115
- Give it a name such as `Wagon Bootcamp` for example
116+
- ❗ It is important that your project **does not** have an organisation ❗
116117
- Notice the `ID` automatically created for the project, e.g. `wagon-bootcamp-123456`
117118

118119
![](images/gcp_project.png)
@@ -613,12 +614,14 @@ If you want to view your SSH configuration:
613614

614615
</details>
615616

616-
🚨🚨🚨 **The setup of your local machine is complete. All following terminal commands will be run from within your virtual machine terminal (via VS Code)** 🚨🚨🚨
617+
Congratulations, the setup of you local laptop is complete πŸŽ‰ We just need to fine tune your Virtual Machine πŸͺ›
617618

618619
---
619620

620621
# Part 2: Configure your Virtual Machine 1
621622

623+
🚨🚨🚨 **All following terminal commands will be run from within your virtual machine terminal, via VS Code** 🚨🚨🚨
624+
622625

623626
## VM gcloud and Application Default Credentials
624627

@@ -728,7 +731,7 @@ And the playbook should start running!
728731

729732
### What is the playbook installing?
730733

731-
This playbook is installing a few things, while the playbook is running, let's go through them:
734+
While this playbook is running, lets go through what is being installed and configured:
732735
- Updating system packages. Ubuntu uses the `APT` package manager.
733736
- Changing the default shell from **bash** to **zsh**, a more customizable shell that is extensible and looks great!
734737
- Installing the **Oh-My-ZSH** plugin for the **zsh** shell. We'll use it a bit later to add some quality of life plugins and extensions for `zsh`.
@@ -741,6 +744,8 @@ This playbook is installing a few things, while the playbook is running, let's g
741744

742745
The playbook is also running checks to see if things are installed or not. This is so you can safely re-run the playbook without any problems.
743746

747+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part1.yml)
748+
744749

745750
## GitHub CLI
746751

@@ -880,15 +885,9 @@ And the playbook should start running! If you're asked if you want VS Code to be
880885

881886
❗ If any errors occur, raise a ticket with a teacher. You can safely run the playbook again.
882887

883-
<details>
884-
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
885-
886-
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
887-
</details>
888-
889888
### What is the playbook installing?
890889

891-
This playbook is installing and configuring a things, while the playbook is running, let's go through them:
890+
While the playbook is running, let's go through what is being installed and configured.
892891

893892
**Python and Poetry**
894893

@@ -923,23 +922,31 @@ Ubuntu 22.04 has Python pre-installed, but not the version we're going to use. W
923922
- **gcloud**: Auto-complete for the gcloud CLI tool
924923
- **ssh-agent**: Saves your SSH password so you only have to enter it once per session.
925924
- **direnv**: A tool to load `.envrc` files when you `cd` into a directory. Great for loading environment variables.
926-
- Installing **Spark**: Spark is a distributed data processing framework
925+
- Installing **Spark**: A distributed data processing framework
927926

928927
**Data Engineering Challenges Repository**
929928

930929
The challenges that you'll be working on throughout the bootcamp! The playbook is forking the **data-engineering-challenges** repository from **lewagon** to your own GitHub user. Then cloning that repository from your GitHub account down onto your Virtual Machine.
931930

931+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part2.yml)
932+
933+
<details>
934+
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
935+
936+
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
937+
</details>
938+
932939
### Restart Virtual Machine
933940

934-
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates (specifically **pyenv** and **Docker**).
941+
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates properly (specifically **pyenv** and **Docker**).
935942

936943
To shutdown your VM, navigate to the GCP Compute Engine Instances [console page πŸ”—](https://console.cloud.google.com/compute/instances).
937944

938945
Select your VM instance and click on the stop button:
939946

940947
![](/images/gcp_vm_stop.png)
941948

942-
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console doesn't dynamically update.
949+
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console (web GUI) doesn't dynamically update.
943950

944951
When the VM is completely off, turn it on again by selecting the check box next to your instance and clicking **START/RESUME**. Give it a minute to turn on, then connect via VS Code.
945952

β€Ž_partials/gcp_setup.mdβ€Ž

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,7 @@
1212
![](images/gcp-create-project.png)
1313

1414
- Give it a name such as `Wagon Bootcamp` for example
15+
- ❗ It is important that your project **does not** have an organisation ❗
1516
- Notice the `ID` automatically created for the project, e.g. `wagon-bootcamp-123456`
1617

1718
![](images/gcp_project.png)

β€Ž_partials/ubuntu_ansible_part1.mdβ€Ž

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -50,7 +50,7 @@ And the playbook should start running!
5050

5151
### What is the playbook installing?
5252

53-
This playbook is installing a few things, while the playbook is running, let's go through them:
53+
While this playbook is running, lets go through what is being installed and configured:
5454
- Updating system packages. Ubuntu uses the `APT` package manager.
5555
- Changing the default shell from **bash** to **zsh**, a more customizable shell that is extensible and looks great!
5656
- Installing the **Oh-My-ZSH** plugin for the **zsh** shell. We'll use it a bit later to add some quality of life plugins and extensions for `zsh`.
@@ -62,3 +62,5 @@ This playbook is installing a few things, while the playbook is running, let's g
6262
- Install the **GitHub CLI**: the CLI tool that we'll use to interact with your GitHub account directly from the terminal.
6363

6464
The playbook is also running checks to see if things are installed or not. This is so you can safely re-run the playbook without any problems.
65+
66+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part1.yml)

β€Ž_partials/ubuntu_ansible_part2.mdβ€Ž

Lines changed: 12 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -22,15 +22,9 @@ And the playbook should start running! If you're asked if you want VS Code to be
2222

2323
❗ If any errors occur, raise a ticket with a teacher. You can safely run the playbook again.
2424

25-
<details>
26-
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
27-
28-
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
29-
</details>
30-
3125
### What is the playbook installing?
3226

33-
This playbook is installing and configuring a things, while the playbook is running, let's go through them:
27+
While the playbook is running, let's go through what is being installed and configured.
3428

3529
**Python and Poetry**
3630

@@ -65,22 +59,30 @@ Ubuntu 22.04 has Python pre-installed, but not the version we're going to use. W
6559
- **gcloud**: Auto-complete for the gcloud CLI tool
6660
- **ssh-agent**: Saves your SSH password so you only have to enter it once per session.
6761
- **direnv**: A tool to load `.envrc` files when you `cd` into a directory. Great for loading environment variables.
68-
- Installing **Spark**: Spark is a distributed data processing framework
62+
- Installing **Spark**: A distributed data processing framework
6963

7064
**Data Engineering Challenges Repository**
7165

7266
The challenges that you'll be working on throughout the bootcamp! The playbook is forking the **data-engineering-challenges** repository from **lewagon** to your own GitHub user. Then cloning that repository from your GitHub account down onto your Virtual Machine.
7367

68+
πŸ’‘ Curious about how Ansible playbooks are defined, take a look at the playbook being run at this [link here πŸ”—](https://github.com/lewagon/data-engineering-setup/blob/main-automation/automation/vm-ansible-setup/playbooks/setup_vm_part2.yml)
69+
70+
<details>
71+
<summary markdown='span'>❓ Why two Ansible playbooks?</summary>
72+
73+
This second ansible playbook requires GitHub authorisation to fork the `lewagon/data-engineering-challenges` repository and it is also editing some of the Le Wagon recommended **dotfiles**. So we separated the process into two steps.
74+
</details>
75+
7476
### Restart Virtual Machine
7577

76-
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates (specifically **pyenv** and **Docker**).
78+
Once the playbook has finished running, you need to completely shutdown your Virtual Machine so that some of the configuration updates properly (specifically **pyenv** and **Docker**).
7779

7880
To shutdown your VM, navigate to the GCP Compute Engine Instances [console page πŸ”—](https://console.cloud.google.com/compute/instances).
7981

8082
Select your VM instance and click on the stop button:
8183

8284
![](/images/gcp_vm_stop.png)
8385

84-
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console doesn't dynamically update.
86+
Wait for a few minutes until the VM shows that it is completely off. You may need to refresh the page, the GCP Console (web GUI) doesn't dynamically update.
8587

8688
When the VM is completely off, turn it on again by selecting the check box next to your instance and clicking **START/RESUME**. Give it a minute to turn on, then connect via VS Code.

β€Ž_partials/vscode_ssh_connection.mdβ€Ž

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,8 +80,10 @@ If you want to view your SSH configuration:
8080

8181
</details>
8282

83-
🚨🚨🚨 **The setup of your local machine is complete. All following terminal commands will be run from within your virtual machine terminal (via VS Code)** 🚨🚨🚨
83+
Congratulations, the setup of you local laptop is complete πŸŽ‰ We just need to fine tune your Virtual Machine πŸͺ›
8484

8585
---
8686

8787
# Part 2: Configure your Virtual Machine 1
88+
89+
🚨🚨🚨 **All following terminal commands will be run from within your virtual machine terminal, via VS Code** 🚨🚨🚨

0 commit comments

Comments
Β (0)