Data Science – The Next Thing https://gnaeus.net Data Privacy, Data Protection, Tor, Data Analysis, Internet Security Sun, 06 Feb 2022 12:48:14 +0000 en-GB hourly 1 https://wordpress.org/?v=6.8.3 WSL: Vmmem.exe high CPU Usage https://gnaeus.net/wsl-vmmem-exe-high-cpu-usage Sat, 05 Feb 2022 11:58:00 +0000 https://gnaeus.net/?p=71 Read more]]> Update: I noticed that the Vmmem.exe popped up with a high CPU Usage after the docker installation with the WSL but I found a solution after some research.

You need to restart the WSL and in addition to avoid this problem in future, you can create an config file as below:

If you open Windows Power Shell, type below command which will restart the WSL:

Restart WSL

wsl --shutdown

Configuration file

By creating an config file, we can disable this issue. This file need to be created as it doesn’t exist usually. Open an text editor and add the 2 lines as below, save it in the folder:

/Users/USERNAME/         

file name:        .wslconfig

[wsl2]
guiApplications=false

Note: save the file as .wslconfig (don’t forget the dot in front of it, and make sure you don’t save it as txt extension file.

Restart.

Note: Additional read, the official Microsoft documentation on this config file.

]]>
Anaconda in a Docker Container https://gnaeus.net/anaconda-in-a-docker-container Thu, 03 Feb 2022 11:18:00 +0000 https://gnaeus.net/?p=67 Read more]]> Previously I have shared my thoughts on Anaconda as a Python Environment and Docker as a Container Visualisation. In this post I would like share my experience on how to run Anaconda within a Docker Container and give you the first steps in doing so.

Read my blog about how to install docker, here.

How to setup a Anaconda Container

Create a Work Folder on your local hard disk

  • (1) First create a folder on your local hard disk. If you use Windows open the cmd (Windows + R and then cmd) or a terminal on Linux/Mac OS.
  • (2) Within Command Window / Terminal: mkdir NAME and then move into this folder with cd NAME

Anaconda Container & Linking it to the Home Folder

Now that you are in the newly created folder we will create now the Docker Container, with following command we will download the latest Anaconda Image (please be aware that can be few hundreds MB), and then create a new container that will use above new folder as home folder, and telling the container that we want access this folder via Webbrowser (local host).

On Windows: Open a power shell window (Windows + R and type powershell) and make sure you are in the new created folder (cd NAME) and used below command:

docker run -it -p 8888:8888 -p 5000:5000 -v ${PWD}:/home --name anaconda3_env continuumio/anaconda3

On Mac/Linux: Make sure you are in the new created folder (cd NAME) and run below command line in the terminal.

docker run -it -p 8888:8888 -p 8888.888 -p 5000:5000 -v "$PWD":/home --name anaconda3_env continuumio/anaconda3 

To explain: this will pull the latest Anaconda Image from the docker hub server. Since you run this command from within your created new folder it will link this as home folder to the container and the new container will have the name ‘anaconda3_env’ and provides access via the ports 8888.

-it stands for interactive terminal, -p forwards and opens a port, -v mounts the working directory into the container, --name gives the container its name

Now the container should be visible in your Docker Desktop Application with the name ‘anaconda_env_’.

Launching Jupyter Lab using the Container

If you go to your Container within Docker, there are several buttons next to each container.

First opens a terminal (we will need that in a minute), second stops/starts the container, next restarts and delete (only if the container has been stopped before).

  1. Start the container with the arrow button.
  2. Open the Terminal via the Terminal button and type below command
jupyter lab --ip='0.0.0.0' --port=8888 --no-browser --allow-root --notebook-dir=/home

This command will give you access via your Webbrowser to the Jupiter Lab within your container. The terminal window will give you the accurate and correct link that you can copy and paste into your browser to access the Jupiter Lab.

Enjoy.

]]>
Docker – The container virtualisation software. https://gnaeus.net/docker-the-container-virtualisation-software https://gnaeus.net/docker-the-container-virtualisation-software#comments Sun, 30 Jan 2022 10:43:00 +0000 https://gnaeus.net/?p=58 Read more]]>

Docker is a freely (personal usage) available container virtualisation software. With the help of the Docker engine, applications including their application environment can be deployed in parallel and isolated from each other on a host system. The software is available for operating systems such as Linux, Windows and macOS. Unlike virtual machines, Docker containers do not require virtualization of the operating system.

There are plenty ready images to choice from and for every needs.

Official Website: https://www.docker.com

Download & Installation

Download from above linked Official Website the Docker Desktop for your operating system. Once completed, run the installer, recommended to select during the installation in the ‘Configuration’ window ‘Enable WSL2 Features’ and ‘Add shortcut to desktop’.

Note: You you install Docker on Windows you may get an ‘WSL 2 installation is incomplete’ notification. No panic, just follow the link and install the kernel (also follow the settings to set it as default on the prompted link.

Next Reboot.

On Docker Hub you will find a list of images that you can try out. I will take the opportunity to share in a later blog one or two examples, how I use them and what for.

Official Website: Docker Hub

]]>
https://gnaeus.net/docker-the-container-virtualisation-software/feed 1
Anaconda Navigator – A great tool for starting with Python, R and more https://gnaeus.net/anaconda-navigator-a-great-tool-for-starting-with-python-r-and-more Sun, 16 Jan 2022 15:56:00 +0000 http://gnaeus.net/?p=52 Read more]]> There are many great tools out there – however some of them need more experience or aren’t supporting all platforms.

When I was looking for a tool for Python and R I come across Anaconda Navigator. I really love how easy it is to setup and install, it supports Mac, Windows and Linux and has a great list of Applications to use and choice from.

And the best of all, it’s free to use (individual edition).

So if you like to start with data science, for school, study or just for fun, have a look at Anaconda Navigator.

Website: Anaconda

]]>
First Post https://gnaeus.net/first-post Wed, 15 Dec 2021 23:52:00 +0000 http://gnaeus.net/?p=6 Read more]]> My goal here is to encourage and inspire you to take care of your computer & internet security. I will share here ideas and projects for the weekend, try to give you ideas and inspirations. Some of the projects may will be something completely different but still fun to do or to learn.

Projects could be

  • Internet Security (e.g. Tor)
  • Computer Security
  • Data Science and Tools
  • and more
]]>