You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: LINUX.md
+23-21Lines changed: 23 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,8 +6,8 @@ A part of the setup will be done on your **local machine** but most of the confi
6
6
7
7
Please **read instructions carefully and execute all commands in the following order**. If you get stuck, don't hesitate to ask a teacher for help :raising_hand:
8
8
9
-
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
-
-**Terraform** excels at creating and destroying cloud resources, like virtual machines, IP addresses, databases and more!
9
+
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **Ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
+
-**Terraform** excels at creating and destroying cloud resources - like virtual machines, IP addresses, databases and more!
11
11
-**Ansible** is used to configure linux machines with specific settings and software. Perfect for fine-tuning the Virtual Machine you will be creating with Terraform!
12
12
13
13
There are three main components to the setup!
@@ -41,7 +41,7 @@ In this section you will:
41
41
2. Test your set up to make sure that everything has installed correctly
42
42
3. Create isolated python environments for all your challenges
43
43
44
-
Don't worry, we'll go into more detail in each of the individual sections.
44
+
Don't worry, we'll go into more detail in each of the individual sections π
45
45
46
46
Let's start :rocket:
47
47
@@ -391,7 +391,7 @@ And follow the prompts. It should open a web-page to login to your Google accoun
391
391
392
392
## Terraform
393
393
394
-
Terraform is a tool for infrastructure as code (IAC) to create (and destroy) resources to create in the cloud.
394
+
Terraform is a tool for [Infrastructure as Code (IaC) π](https://en.wikipedia.org/wiki/Infrastructure_as_code)to create, destroy, and manage resources in the cloud.
β If an errors occur, raise a ticket with a teacher. You can safely run the ansible playbook again.
754
+
β If an errors occur, raise a ticket with a teacher. The ansible playbooks are designed so that they can be run again, and again, and again and only make the changes that are required.
755
755
756
756
### What is the playbook installing?
757
757
@@ -823,11 +823,11 @@ gh auth status
823
823
824
824
## Dotfiles
825
825
826
-
Let's jazz up your terminal, zsh, and VS Code by installing Le Wagon's curated[dotfiles](http://github.com/lewagon/dotfiles)**on your Virtual Machine**.
826
+
Let's enhance the developer experience on your Virtual Machine by install Le Wagon's pre-configured[dotfiles π](https://github.com/lewagon/dotfiles)for your terminal, zsh and VS Code.
827
827
828
-
To make this setup your own and customise it further to suit yourself, you'll need to make a _fork_ of it and store it on your own Github account.
828
+
To customise this configuration for yourself, you'll need to **fork** the repository to your own Github account.
829
829
830
-
Forking means that it will create a new repo in your GitHub account, identical to the original one. You'll have a new repository on your GitHub account, `your_github_username/dotfiles`. We need to fork because each of you will need to put specific information (e.g. your name) in those files.
830
+
**Forking** creates a copy of the repository under your account (`your_github_username/dotfiles`), which you can then modify with your personal information, such as your name.
831
831
832
832
Open your terminal on your VM and run the following command:
833
833
@@ -840,7 +840,7 @@ You should see your Github username printed.
840
840
841
841
β If you do not see your Github username being printed - **stop here** - and raise a ticket with a TA π There may be a problem with the previous step (`gh auth`).
842
842
843
-
Time to fork the repo and clone it on your Virtual Machine:
843
+
To fork the Le Wagon dotfiles repository and clone it on your Virtual Machine. Execute the following command:
844
844
845
845
```bash
846
846
mkdir -p ~/code/$GITHUB_USERNAME&&cd$_
@@ -868,8 +868,10 @@ cd ~/code/$GITHUB_USERNAME/dotfiles && zsh git_setup.sh
868
868
869
869
:point_up: This will **prompt** you for your name (`FirstName LastName`) and your email.
870
870
871
-
:warning: You **need** to put one of the emails listed above thanks to the previous `gh api ...` command.
872
-
If you don't enter a valid email, Kitt will not be able to track your progress. π‘ Select the `@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
871
+
:warning: You **need** to put one of the emails listed above from the previous `gh api ...` command.
872
+
If you do not enter a valid email, Kitt will not be able to track your progress.
873
+
874
+
π‘ Select the `...@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
873
875
874
876
875
877
---
@@ -1005,7 +1007,7 @@ Should return:
1005
1007
* 3.12.8 (set by /home/<your_username>/.pyenv/version)
1006
1008
```
1007
1009
1008
-
Note: There should be an`*` next to 3.12.8
1010
+
β Note: There should be a`*` next to 3.12.8
1009
1011
1010
1012
#### Pipx
1011
1013
@@ -1021,11 +1023,11 @@ Should return something similar too:
1021
1023
venvs are in /home/<your_username>/.local/share/pipx/venvs
1022
1024
apps are exposed on your $PATH at /home/<your_username>/.local/bin
1023
1025
manual pages are exposed at /home/<your_username>/.local/share/man
1024
-
package poetry 2.1.1, installed using Python 3.12.8
1026
+
package poetry 2.3.1, installed using Python 3.12.8
1025
1027
- poetry
1026
-
package ruff 0.11.0, installed using Python 3.12.8
1028
+
package ruff 0.14.13, installed using Python 3.12.8
1027
1029
- ruff
1028
-
package tldr 3.3.0, installed using Python 3.12.8
1030
+
package tldr 3.4.3, installed using Python 3.12.8
1029
1031
- tldr
1030
1032
- man1/tldr.1
1031
1033
```
@@ -1101,7 +1103,7 @@ Should return:
1101
1103
π Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default
1102
1104
```
1103
1105
1104
-
And then make sure the kubernetes CLI utility, `kubectl`, works with:
1106
+
And then to make sure the kubernetes CLI utility, `kubectl`, works, run the following in your terminal:
From challenge folder root **on the vm**, we'll run `make install`, which triggers 3 operations:
1219
+
From the `data-engineering-challenges`folder root **on your VM**, we'll run `make install`, which triggers 3 operations:
1218
1220
1219
-
-`make install-poetry`: `cd`inside each challenge folders, and `poetry install` inside each! (takes a while)
1220
-
-`make allow-envrc`: allow direnv to execute inside each folder (otherwise you have to manually "allow" it)
1221
+
-`make install-poetry`: `cd`(**c**hange **d**irectory) into each challenge folder, and run`poetry install` inside each! (takes a while)
1222
+
-`make allow-envrc`: allow `direnv` to execute inside each folder (otherwise you have to manually "allow" it)
1221
1223
-`make own-repo`: allows your user to be the linux "owner" of all files in this challenge folder
1222
1224
1223
1225
Let's make!
@@ -1226,7 +1228,7 @@ Let's make!
1226
1228
make install
1227
1229
```
1228
1230
1229
-
This will take a while. You have time to grab a coffee βοΈ, take a break, or start the next step while all your poetry environments are installing.
1231
+
This might take a while. You have time to grab a coffee βοΈ, take a break, or start the next step while all your poetry environments are installing.
1230
1232
1231
1233
β οΈ If at the very end of this process you get a few errors like: `direnv: error .envrc file not found` or a Python version isn't available (relating to `Dask`) - that is normal and nothing to worry about π
Copy file name to clipboardExpand all lines: WINDOWS.md
+23-21Lines changed: 23 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,8 +6,8 @@ A part of the setup will be done on your **local machine** but most of the confi
6
6
7
7
Please **read instructions carefully and execute all commands in the following order**. If you get stuck, don't hesitate to ask a teacher for help :raising_hand:
8
8
9
-
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
-
-**Terraform** excels at creating and destroying cloud resources, like virtual machines, IP addresses, databases and more!
9
+
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **Ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
+
-**Terraform** excels at creating and destroying cloud resources - like virtual machines, IP addresses, databases and more!
11
11
-**Ansible** is used to configure linux machines with specific settings and software. Perfect for fine-tuning the Virtual Machine you will be creating with Terraform!
12
12
13
13
There are three main components to the setup!
@@ -41,7 +41,7 @@ In this section you will:
41
41
2. Test your set up to make sure that everything has installed correctly
42
42
3. Create isolated python environments for all your challenges
43
43
44
-
Don't worry, we'll go into more detail in each of the individual sections.
44
+
Don't worry, we'll go into more detail in each of the individual sections π
45
45
46
46
Let's start :rocket:
47
47
@@ -333,7 +333,7 @@ And follow the prompts. It should open a web-page to login to your Google accoun
333
333
334
334
## Terraform
335
335
336
-
Terraform is a tool for infrastructure as code (IAC) to create (and destroy) resources to create in the cloud.
336
+
Terraform is a tool for [Infrastructure as Code (IaC) π](https://en.wikipedia.org/wiki/Infrastructure_as_code)to create, destroy, and manage resources in the cloud.
β If an errors occur, raise a ticket with a teacher. You can safely run the ansible playbook again.
726
+
β If an errors occur, raise a ticket with a teacher. The ansible playbooks are designed so that they can be run again, and again, and again and only make the changes that are required.
727
727
728
728
### What is the playbook installing?
729
729
@@ -795,11 +795,11 @@ gh auth status
795
795
796
796
## Dotfiles
797
797
798
-
Let's jazz up your terminal, zsh, and VS Code by installing Le Wagon's curated[dotfiles](http://github.com/lewagon/dotfiles)**on your Virtual Machine**.
798
+
Let's enhance the developer experience on your Virtual Machine by install Le Wagon's pre-configured[dotfiles π](https://github.com/lewagon/dotfiles)for your terminal, zsh and VS Code.
799
799
800
-
To make this setup your own and customise it further to suit yourself, you'll need to make a _fork_ of it and store it on your own Github account.
800
+
To customise this configuration for yourself, you'll need to **fork** the repository to your own Github account.
801
801
802
-
Forking means that it will create a new repo in your GitHub account, identical to the original one. You'll have a new repository on your GitHub account, `your_github_username/dotfiles`. We need to fork because each of you will need to put specific information (e.g. your name) in those files.
802
+
**Forking** creates a copy of the repository under your account (`your_github_username/dotfiles`), which you can then modify with your personal information, such as your name.
803
803
804
804
Open your terminal on your VM and run the following command:
805
805
@@ -812,7 +812,7 @@ You should see your Github username printed.
812
812
813
813
β If you do not see your Github username being printed - **stop here** - and raise a ticket with a TA π There may be a problem with the previous step (`gh auth`).
814
814
815
-
Time to fork the repo and clone it on your Virtual Machine:
815
+
To fork the Le Wagon dotfiles repository and clone it on your Virtual Machine. Execute the following command:
816
816
817
817
```bash
818
818
mkdir -p ~/code/$GITHUB_USERNAME&&cd$_
@@ -840,8 +840,10 @@ cd ~/code/$GITHUB_USERNAME/dotfiles && zsh git_setup.sh
840
840
841
841
:point_up: This will **prompt** you for your name (`FirstName LastName`) and your email.
842
842
843
-
:warning: You **need** to put one of the emails listed above thanks to the previous `gh api ...` command.
844
-
If you don't enter a valid email, Kitt will not be able to track your progress. π‘ Select the `@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
843
+
:warning: You **need** to put one of the emails listed above from the previous `gh api ...` command.
844
+
If you do not enter a valid email, Kitt will not be able to track your progress.
845
+
846
+
π‘ Select the `...@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
845
847
846
848
847
849
---
@@ -977,7 +979,7 @@ Should return:
977
979
* 3.12.8 (set by /home/<your_username>/.pyenv/version)
978
980
```
979
981
980
-
Note: There should be an`*` next to 3.12.8
982
+
β Note: There should be a`*` next to 3.12.8
981
983
982
984
#### Pipx
983
985
@@ -993,11 +995,11 @@ Should return something similar too:
993
995
venvs are in /home/<your_username>/.local/share/pipx/venvs
994
996
apps are exposed on your $PATH at /home/<your_username>/.local/bin
995
997
manual pages are exposed at /home/<your_username>/.local/share/man
996
-
package poetry 2.1.1, installed using Python 3.12.8
998
+
package poetry 2.3.1, installed using Python 3.12.8
997
999
- poetry
998
-
package ruff 0.11.0, installed using Python 3.12.8
1000
+
package ruff 0.14.13, installed using Python 3.12.8
999
1001
- ruff
1000
-
package tldr 3.3.0, installed using Python 3.12.8
1002
+
package tldr 3.4.3, installed using Python 3.12.8
1001
1003
- tldr
1002
1004
- man1/tldr.1
1003
1005
```
@@ -1073,7 +1075,7 @@ Should return:
1073
1075
π Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default
1074
1076
```
1075
1077
1076
-
And then make sure the kubernetes CLI utility, `kubectl`, works with:
1078
+
And then to make sure the kubernetes CLI utility, `kubectl`, works, run the following in your terminal:
From challenge folder root **on the vm**, we'll run `make install`, which triggers 3 operations:
1191
+
From the `data-engineering-challenges`folder root **on your VM**, we'll run `make install`, which triggers 3 operations:
1190
1192
1191
-
-`make install-poetry`: `cd`inside each challenge folders, and `poetry install` inside each! (takes a while)
1192
-
-`make allow-envrc`: allow direnv to execute inside each folder (otherwise you have to manually "allow" it)
1193
+
-`make install-poetry`: `cd`(**c**hange **d**irectory) into each challenge folder, and run`poetry install` inside each! (takes a while)
1194
+
-`make allow-envrc`: allow `direnv` to execute inside each folder (otherwise you have to manually "allow" it)
1193
1195
-`make own-repo`: allows your user to be the linux "owner" of all files in this challenge folder
1194
1196
1195
1197
Let's make!
@@ -1198,7 +1200,7 @@ Let's make!
1198
1200
make install
1199
1201
```
1200
1202
1201
-
This will take a while. You have time to grab a coffee βοΈ, take a break, or start the next step while all your poetry environments are installing.
1203
+
This might take a while. You have time to grab a coffee βοΈ, take a break, or start the next step while all your poetry environments are installing.
1202
1204
1203
1205
β οΈ If at the very end of this process you get a few errors like: `direnv: error .envrc file not found` or a Python version isn't available (relating to `Dask`) - that is normal and nothing to worry about π
Copy file name to clipboardExpand all lines: _partials/dotfiles_simple.md
+8-6Lines changed: 8 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,10 +1,10 @@
1
1
## Dotfiles
2
2
3
-
Let's jazz up your terminal, zsh, and VS Code by installing Le Wagon's curated[dotfiles](http://github.com/lewagon/dotfiles)**on your Virtual Machine**.
3
+
Let's enhance the developer experience on your Virtual Machine by install Le Wagon's pre-configured[dotfiles π](https://github.com/lewagon/dotfiles)for your terminal, zsh and VS Code.
4
4
5
-
To make this setup your own and customise it further to suit yourself, you'll need to make a _fork_ of it and store it on your own Github account.
5
+
To customise this configuration for yourself, you'll need to **fork** the repository to your own Github account.
6
6
7
-
Forking means that it will create a new repo in your GitHub account, identical to the original one. You'll have a new repository on your GitHub account, `your_github_username/dotfiles`. We need to fork because each of you will need to put specific information (e.g. your name) in those files.
7
+
**Forking** creates a copy of the repository under your account (`your_github_username/dotfiles`), which you can then modify with your personal information, such as your name.
8
8
9
9
Open your terminal on your VM and run the following command:
10
10
@@ -17,7 +17,7 @@ You should see your Github username printed.
17
17
18
18
β If you do not see your Github username being printed - **stop here** - and raise a ticket with a TA π There may be a problem with the previous step (`gh auth`).
19
19
20
-
Time to fork the repo and clone it on your Virtual Machine:
20
+
To fork the Le Wagon dotfiles repository and clone it on your Virtual Machine. Execute the following command:
21
21
22
22
```bash
23
23
mkdir -p ~/code/$GITHUB_USERNAME&&cd$_
@@ -45,5 +45,7 @@ cd ~/code/$GITHUB_USERNAME/dotfiles && zsh git_setup.sh
45
45
46
46
:point_up: This will **prompt** you for your name (`FirstName LastName`) and your email.
47
47
48
-
:warning: You **need** to put one of the emails listed above thanks to the previous `gh api ...` command.
49
-
If you don't enter a valid email, Kitt will not be able to track your progress. π‘ Select the `@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
48
+
:warning: You **need** to put one of the emails listed above from the previous `gh api ...` command.
49
+
If you do not enter a valid email, Kitt will not be able to track your progress.
50
+
51
+
π‘ Select the `...@users.noreply.github.com` address if you don't want your email to appear in public repositories you may contribute to.
Copy file name to clipboardExpand all lines: _partials/intro.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,8 +6,8 @@ A part of the setup will be done on your **local machine** but most of the confi
6
6
7
7
Please **read instructions carefully and execute all commands in the following order**. If you get stuck, don't hesitate to ask a teacher for help :raising_hand:
8
8
9
-
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
-
-**Terraform** excels at creating and destroying cloud resources, like virtual machines, IP addresses, databases and more!
9
+
This setup is largely automated with [**Terraform** π](https://developer.hashicorp.com/terraform) and [**Ansible** π](https://docs.ansible.com/). **Terraform** and **Ansible** are [_Infrastructure as Code_ π](https://en.wikipedia.org/wiki/Infrastructure_as_code) tools.
10
+
-**Terraform** excels at creating and destroying cloud resources - like virtual machines, IP addresses, databases and more!
11
11
-**Ansible** is used to configure linux machines with specific settings and software. Perfect for fine-tuning the Virtual Machine you will be creating with Terraform!
12
12
13
13
There are three main components to the setup!
@@ -41,7 +41,7 @@ In this section you will:
41
41
2. Test your set up to make sure that everything has installed correctly
42
42
3. Create isolated python environments for all your challenges
43
43
44
-
Don't worry, we'll go into more detail in each of the individual sections.
44
+
Don't worry, we'll go into more detail in each of the individual sections π
0 commit comments