Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 22
Posts: 22   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 10288 times and has 21 replies Next Thread
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

Lower cost Network's and security : HPC High-performance-computing Nodes

Network Communications data for telecommunications and technology... HPC High-performance-computing Node Networking.

https://blog.cloudflare.com/bandwidth-allience/

https://blog.cloudflare.com/birthday-week-2018-wrap-up/

https://blog.cloudflare.com/crypto-week-2018/

RS https://science.n-helix.com
[Sep 28, 2018 11:57:45 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

Raba B on Sep 30, 3:31 PM

You can apply for our entrepreneurial program where you receive credits every month to use our services: https://www.softlayer.com/IBMGEP-application You can apply on the following link.

IBM Cloud
https://console.bluemix.net/catalog/
https://console.bluemix.net/pricing/
https://www.ibm.com/cloud/pricing
https://developer.ibm.com/academic/

https://console.bluemix.net/pricing/configure/iaas/containers-kubernetes
[Sep 30, 2018 3:30:03 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

Curiosity 4 Intel Xeon E7 - worth a good read : RS https://science.n-helix.com
Intel Xeon E7-4890 v2
Quad Intel Xeon E7-4890 v2 (60 Cores, 2.80 GHz)
128GB RAM (2048GB maximum)
Up to 24 Internal Hard Drives
Up to 10Gbps maximum Port Speeds
Redundant Power Supplies

https://www.ibm.com/cloud-computing/bluemix/b...ourlyPrice%5Bmax%5D=5.500

updated : http://science.n-helix.com/2018/09/hpc-pack-install-guide.html
----------------------------------------
[Edit 1 times, last edit by QuantumEthos at Oct 2, 2018 8:21:15 PM]
[Oct 2, 2018 2:08:27 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
rose Re: HPC Community Configuration RS - some advice

Simplified HPC Pack install guide : Science,Server & Web : RS

http://science.n-helix.com/2018/09/hpc-pack-install-guide.html - guided install
http://science.n-helix.com/2018/09/hpc.html - a bit about boinc in terms of Docker & Microsoft HPC Pack
http://science.n-helix.com/2017/04/boinc.html - HPC, Optimisation & Boinc - programming

https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux
https://docs.microsoft.com/en-us/powershell/h...ng/overview?view=hpc16-ps - updated


Windows server: Step 1

install Microsoft HPC Pack - Microsoft HPC Pack server/Workstation/Unmanaged server/node

Head Node

127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,
cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1

You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

Docker though the install service

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force


Windows 7/8/10: Step 1

install Microsoft HPC Pack node or workstation/server

Head Node

127.0.0.1,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,
cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1

You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

https://docker.com - docker CE for windows 7/8/10 install requiring download and install of docker community edition edge..

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force

and then install docker CE

https://docker.com

Step 2 for both : Enable Kubernets in docker and set available CPU's & Resources then >

admin : CMD

docker run -d --privileged -e SWAPSIZE=16 boomtownroi/swap-manager:latest

docker run --name railgun-memcached -d -p=127.0.0.1:11211:11211 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always memcached:latest

docker run -d --name=squid-memcached -p=127.0.0.1:3128:3128 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always minimum2scp/squid

docker run -d --name=nuster-memcache -p=127.0.0.1:8080:8080 -p=127.0.0.1:443:443 -p=127.0.0.1:80:80 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always nuster/nuster

docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERapiTOKENHERE -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun

docker run --name binddns-resolver -d --restart=always -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -p 53:53/tcp -p 53:53/udp -p 5353:5353/tcp -p 5353:5353/udp -p 10000:10000/tcp --volume /srv/docker/bind:/data sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000

# alternative requires to be configured docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -d --restart=always --volume /srv/docker/bind:/data unixtastic/bind-dnssec-resolver

# Do not forget that the first DNS server is 127.0.0.1

docker run --name nax-waf -e BACKEND_IP=127.0.0.1 -e KIBANA_PASSWORD=Safe5 -d --link railgun-memcached:memcached --restart=always scollazo/naxsi-waf-with-ui

docker exec squid-memcached curl http://127.0.0.1/

****

Selenium runs once - you need to re run it on boot

https://store.docker.com/community/images/selenium/standalone-chrome
https://github.com/SeleniumHQ/docker-selenium

docker run -d -it --rm -p=0.0.0.0:9222:9222 -p=0.0.0.0:443:443 --link railgun-memcached:memcached --name=chrome-headless-selenium -v /tmp/chromedata/:/data selenium/standalone-chrome

port : 4444

https://store.docker.com/community/images/alpeware/chrome-headless-trunk
docker run -d -it --rm -p=0.0.0.0:9222:9222 -p=0.0.0.0:443:443 --name=chrome-headless -v /tmp/chromedata/:/data alpeware/chrome-headless-trunk

port : 9222

****
*waf firewall*
https://hub.docker.com/r/scollazo/naxsi-waf-with-ui/
docker pull scollazo/naxsi-waf-with-ui

*pfsense firewall stuff*
https://hub.docker.com/r/hawaiideveloper/pfsense/
docker pull hawaiideveloper/pfsense

https://hub.docker.com/r/infrascielo/logstash-pfsense/
docker pull infrascielo/logstash-pfsense

*zend php stack is licenced*
https://hub.docker.com/_/php-zendserver/
docker pull php-zendserver

*nginx php stack*
https://hub.docker.com/r/richarvey/nginx-php-fpm/
docker pull richarvey/nginx-php-fpm

*node js*
https://hub.docker.com/r/mhart/alpine-node/
docker pull mhart/alpine-node

*squid cache*
https://hub.docker.com/r/minimum2scp/squid/
docker pull minimum2scp/squid

*Nuster http Cache - needs configuration !*
https://github.com/jiangwenyuan/nuster
https://hub.docker.com/r/nuster/nuster/
docker pull nuster/nuster

*railgun*
https://www.cloudflare.com/docs/railgun/installation.html
https://www.cloudflare.com/docs/railgun/daemon_execution.html

https://hub.docker.com/r/rungeict/cloudflare-railgun/
docker pull rungeict/cloudflare-railgun

https://www.cloudflare.com/website-optimization/railgun/?r=1

*bind DNS*
https://hub.docker.com/r/sameersbn/bind/#introduction
docker pull sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000

****

*squid cache*
https://hub.docker.com/r/minimum2scp/squid/
docker pull minimum2scp/squid

https://hub.docker.com/r/sameersbn/squid/
docker pull sameersbn/squid

****
Nuster http Cache - needs configuration !
https://github.com/jiangwenyuan/nuster
https://hub.docker.com/r/nuster/nuster/
docker pull nuster/nuster

docker run -d --name=nuster-memcache -p=127.0.0.1:8080:8080 -p=127.0.0.1:443:443 -p=127.0.0.1:80:80 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always nuster/nuster

****
*alpine is a tiny linux with many apps very flexible 5mb*
https://hub.docker.com/_/alpine/
docker pull alpine

****
dhcp servers

freeradius dhcp servers
https://hub.docker.com/r/freeradius/freeradius-server/
docker pull freeradius/freeradius-server
docker run -d --name my-radius -p 1812-1813:1812-1813/udp --restart=always freeradius/freeradius-server

RackHD dhcp server
https://rackhd.readthedocs.io/en/latest/
https://github.com/RackHD/
https://hub.docker.com/r/rackhd/isc-dhcp-server/
docker pull rackhd/isc-dhcp-server

docker run -d --name rackhd-dhcp -p 1812-1813:1812-1813/udp --restart=always rackhd/isc-dhcp-server

Alpine dhcp
https://hub.docker.com/r/joebiellik/dhcpd/
docker pull joebiellik/dhcpd

Further reading for swarm node configuration

https://github.com/docker/labs/blob/master/sw...ginner-tutorial/README.md

Traefik : Swarm cloud single ip/site url; header wall that keeps all nodes hidden within to handle web traffic from the singular web portal to inside the node array list (funnels Data, Hence > traefik)

https://github.com/bee42/traefik-with-docker
https://github.com/bee42/docker-orchestration-swarming

https://hub.docker.com/r/bee42/docker-orchestration-swarming/
docker pull bee42/docker-orchestration-swarming

****
Open science grid including tensor flow & GPU
https://hub.docker.com/u/opensciencegrid/

swarm elasticsearch
https://hub.docker.com/r/agoryachev/docker-swarm-elasticsearch/
****
ports : 23,53,443,1812,1813,2408,3128,5353,5454,8080,8888,11211

****
Media server
https://hub.docker.com/r/kurento/kurento-media-server/
docker pull kurento/kurento-media-server
docker run -d --name kms-mediaserver -p 8888:8888 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 kurento/kurento-media-server

Image neural enhancer
https://github.com/alexjc/neural-enhance
https://hub.docker.com/r/alexjc/neural-enhance/
docker pull alexjc/neural-enhance

caffe gpu
https://hub.docker.com/r/tleyden5iwx/caffe-gpu-master/
docker pull tleyden5iwx/caffe-gpu-master

****
Swap VMRam creation
docker pull boomtownroi/swap-manager
docker run -d --privileged -e SWAPSIZE=16 boomtownroi/swap-manager:latest

****
Boinc HPC Computing

https://github.com/BOINC/boinc-client-docker

https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md

https://cosmicmar.com/2016/02/14/boinc-server-docker-1/

Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..

The initial detection system would launch for Container VM & also pull user data into the VM (the necessary ID from project add device & also set the VM and OS use for special case use and non generic project data,
Of special note is the use of Linux containers; This container potentially could batch multiple projects with finesse; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)

docker pull alpine - check this out!

*alpine is a tiny Linux with many apps very flexible 5mb*
https://hub.docker.com/_/alpine/
docker pull alpine

Finally special contained secure environments for HPC Boinc Networking science is realised with relative technical aplume & thusly easily usable by the average; Non average user.

boinc node network on alpine linux with rasberry-pi
https://github.com/firepear/homefarm

****
http://science.n-helix.com/2017/04/boinc.html
----------------------------------------
[Edit 3 times, last edit by QuantumEthos at Oct 22, 2018 6:34:29 PM]
[Oct 21, 2018 1:53:30 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

Science Configuration Proposals : RS

https://drive.google.com/open?id=1VWQXN4tBxcSquqaH2fdmXDgKW5xzmzDO

Windows Virtual Machines Pricing
Pay as you go No upfront cost Per-second billing Save with reserved VM instances
Start your Azure free account and get 12 months free access to Virtual Machines plus $200 credit for 30 days.

ND VMs now available
Designed for artificial intelligence (AI) and deep learning

Powered by NVIDIA Tesla P40 GPUs.
Ideal for AI workloads using CNTK, TensorFlow, Caffe, and other frameworks.
Larger GPU memory sizes of up to 24 GB available.
RDMA and InfiniBand connectivity for large-scale training jobs.


https://azure.microsoft.com/en-us/pricing/details/virtual-machines/windows/
[Nov 5, 2018 6:52:22 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

Serious business expansion : gratis with grace : Be Quick

70% off Hosting for 9 hours! india

https://www.hostinger.in/vps-hosting

Epyc servers
https://www.hapihhost.in/servers_category/amd-epyc-7401p-24-core/

ramnode amsterdam & world
20% OFF ANY NEW VDS! Coupon: SVDS20
https://www.ramnode.com/vps.php

35$ 8 core excettera
https://hostsailor.com/vps-hosting/kvm-vps/windows-vps/

netherlands , russia , usa
https://www.hostkey.com/dedicated-servers/netherlands-sale?scroll

RS https://science.n-helix.com
[Jan 17, 2019 4:26:13 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

[Jan 29, 2019 10:56:24 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
rose Re: HPC Community Configuration RS - some advice

HPC Pack install guide : Science,Server & Web : Rupert S
https://www.microsoft.com/en-us/download/details.aspx?id=54507 Microsoft HPC Pack 2016 including linux

Windows server: Step 1

install Microsoft HPC Pack - Microsoft HPC Pack server/Workstation/Unmanaged server/node

Head Node

127.0.0.1,dn4.n-helix.com,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,
cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1

You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

Docker though the install service

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force

Windows 7/8/10: Step 1

install Microsoft HPC Pack node or workstation/server

Head Node

127.0.0.1,dn4.n-helix.com,dn.n-helix.com,worldcommunitygrid.org,lhcathome.cern.ch,cern.ch,boinc.bakerlab.org,cloudflareworkers.com,
cloudflare.com,cloud.sfr.fr,sfrcloud.sfr.fr,webrlb01.cern.ch,boincai01.cern.ch,8.8.4.4,1.1.1.1


You will need a server certificate such as a comodo or digicert or microsoft.. for the next page of hpc pack install

https://www.gogetssl.com/compare-domain-sslcertificates/

https://docker.com - docker CE for windows 7/8/10 install requiring download and install of docker community edition edge..

powershell Install-PackageProvider -Name NuGet -Force
powershell Install-Module -Name DockerMsftProvider -Repository PSGallery -Force
powershell Install-Package -Name docker -ProviderName DockerMsftProvider -Force
and then install docker CE

https://docker.com

Step 2 for both : Enable Kubernets in docker and set available CPU's & Resources then >

admin : CMD

docker run --name railgun-memcached -d -p=127.0.0.1:11211:11211 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always memcached:latest

docker run -d --name=railgun -p 2408:2408 -e RG_ACT_TOKEN=ENTERapiTOKENHERE -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e RG_WAN_PORT=2408 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always rungeict/cloudflare-railgun

docker run -d --name=squid-memcached -p=127.0.0.1:3128:3128 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --link railgun-memcached:memcached --restart=always minimum2scp/squid

docker run -d --name=nuster-memcache -p=127.0.0.1:8080:8080 -p=127.0.0.1:443:443 -p=127.0.0.1:80:80 -e RG_ACT_HOST=127.0.0.1 -e RG_LOG_LEVEL=1 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 --restart=always nuster/nuster

docker run --name binddns-resolver -d --restart=always -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -p 53:53/tcp -p 53:53/udp -p 5353:5353/tcp -p 5353:5353/udp -p 10000:10000/tcp --volume /srv/docker/bind:/data sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000

# alternative requires to be configured docker run --name=binddns-resolver -d -p 53:53/udp -p 53:53 -d -p 5353:5353/udp -p 5353:5353 -e https_proxy=http://127.0.0.1:3128 -e http_proxy=http://127.0.0.1:3128 -e ftp_proxy=http://127.0.0.1:3128 -d --restart=always --volume /srv/docker/bind:/data unixtastic/bind-dnssec-resolver

# Do not forget that the first DNS server is 127.0.0.1

docker run --name nax-waf -e BACKEND_IP=127.0.0.1 -e KIBANA_PASSWORD=Safe5 -d --link railgun-memcached:memcached --restart=always scollazo/naxsi-waf-with-ui

docker exec squid-memcached curl http://127.0.0.1/

****

Selenium runs once - you need to re run it on boot

https://store.docker.com/community/images/selenium/standalone-chrome

https://github.com/SeleniumHQ/docker-selenium

docker run -d -it --rm -p=0.0.0.0:9222:9222 -p=0.0.0.0:443:443 --link railgun-memcached:memcached --name=chrome-headless-selenium -v /tmp/chromedata/:/data selenium/standalone-chrome

port : 4444


****

*waf firewall*

https://hub.docker.com/r/scollazo/naxsi-waf-with-ui/
docker pull scollazo/naxsi-waf-with-ui

*zend php stack is licenced*

https://hub.docker.com/_/php-zendserver/
docker pull php-zendserver

*nginx php stack*

https://hub.docker.com/r/richarvey/nginx-php-fpm/
docker pull richarvey/nginx-php-fpm

*node js*

https://hub.docker.com/r/mhart/alpine-node/
docker pull mhart/alpine-node

*squid cache*

https://hub.docker.com/r/minimum2scp/squid/
docker pull minimum2scp/squid

*Nuster http Cache - needs configuration !*
https://github.com/jiangwenyuan/nuster
https://hub.docker.com/r/nuster/nuster/
docker pull nuster/nuster

*railgun*

https://www.cloudflare.com/docs/railgun/installation.html
https://www.cloudflare.com/docs/railgun/daemon_execution.html

https://hub.docker.com/r/rungeict/cloudflare-railgun/
docker pull rungeict/cloudflare-railgun
https://www.cloudflare.com/website-optimization/railgun/?r=1

*bind DNS*

https://hub.docker.com/r/sameersbn/bind/#introduction
docker pull sameersbn/bind

# to configure and update binddns-resolver : https://localhost:10000


****

dhcp servers

freeradius dhcp servers

https://hub.docker.com/r/freeradius/freeradius-server/
docker pull freeradius/freeradius-server
docker run -d --name my-radius -p 1812-1813:1812-1813/udp --restart=always freeradius/freeradius-server

RackHD dhcp server

https://rackhd.readthedocs.io/en/latest/
https://github.com/RackHD/
https://hub.docker.com/r/rackhd/isc-dhcp-server/
docker pull rackhd/isc-dhcp-server

docker run -d --name rackhd-dhcp -p 1812-1813:1812-1813/udp --restart=always rackhd/isc-dhcp-server

Alpine dhcp

https://hub.docker.com/r/joebiellik/dhcpd/
docker pull joebiellik/dhcpd

****

https://hackernoon.com/a-kubernetes-guide-for-docker-swarm-users-c14c8aa266cc

https://blog.alexellis.io/you-need-to-know-kubernetes-and-swarm/

Further reading for swarm node configuration
https://github.com/docker/labs/blob/master/sw...ginner-tutorial/README.md

Traefik : Swarm cloud single ip/site url; header wall that keeps all nodes hidden within to handle web traffic from the singular web portal to inside the node array list (funnels Data, Hence > traefik)
https://github.com/bee42/traefik-with-docker
https://github.com/bee42/docker-orchestration-swarming

https://hub.docker.com/r/bee42/docker-orchestration-swarming/
docker pull bee42/docker-orchestration-swarming

****

Open science grid including tensor flow & GPU
https://hub.docker.com/u/opensciencegrid/

swarm elasticsearch

https://hub.docker.com/r/agoryachev/docker-swarm-elasticsearch/

****

Media server

https://hub.docker.com/r/kurento/kurento-media-server/
docker pull kurento/kurento-media-server
docker run -d --name kms-mediaserver -p 8888:8888 kurento/kurento-media-server

Image neural enhancer

https://github.com/alexjc/neural-enhance
https://hub.docker.com/r/alexjc/neural-enhance/
docker pull alexjc/neural-enhance

caffe gpu
https://hub.docker.com/r/tleyden5iwx/caffe-gpu-master/
docker pull tleyden5iwx/caffe-gpu-master

****

Boinc HPC Computing

https://github.com/BOINC/boinc-client-docker

https://github.com/marius311/boinc-server-docker/blob/master/docs/cookbook.md

https://cosmicmar.com/2016/02/14/boinc-server-docker-1/

Our suggestion of boinc detection of docker (docker launch takes 15 seconds plus so boinc would have to wait for the process to initiate in the windows task manager before..

The initial detection system would launch for Container VM & also pull user data into the VM (the necessary ID from project add device & also set the VM and OS use for special case use and non generic project data,
Of special note is the use of Linux containers; This container potentially could batch multiple projects with finesse; In particular Science Linux and Alpine (for size and usability) (science kernel version is possible)

docker pull alpine - check this out!

*alpine is a tiny Linux with many apps very flexible 5mb*
https://hub.docker.com/_/alpine/
docker pull alpine


Finally special contained secure environments for HPC Boinc Networking science is realised with relative technical aplume & thusly easily usable by the average; Non average user.

boinc node network on alpine linux with rasberry-pi
https://github.com/firepear/homefarm

****

https://science.n-helix.com/2018/09/hpc-pack-install-guide.html
http://science.n-helix.com/2018/09/hpc.html - a bit about boinc in terms of Docker & Microsoft HPC Pack
http://science.n-helix.com/2017/04/boinc.html - HPC, Optimisation & Boinc - programming
[Mar 9, 2019 11:40:24 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
rose Re: HPC Community Configuration RS - some advice

Kubernets and HPC properly explained : RS
When you enable Kubernet in docker in the console (CMD) : kubectl: Kubernets ingress controller security: If you use cloudflared & or a local certificate : the HPC Certificate you got: https://kubernetes.io/
https://www.gogetssl.com/compare-domain-sslcertificates/

(CMD):

kubectl create secret generic 127.0.0.1 --from-file="$HOME/.cloudflared/cert.pem"

kubectl create secret generic localhost --from-file="$HOME/.cloudflared/cert.pem"

Reference material:

Make your computer system into a high Performance compute HPC node,
Read all the guidance in the texts attached!
Soon we will have the best computers in the world.

Regards RS https://science.n-helix.com

https://is.gd/HighPerformanceCG

***

Better router settings for lightspeed internet.

ktune deflate 15,15 bsdcomp 15,15

https://is.gd/RouterFirmwareUpgradeDL
----------------------------------------
[Edit 1 times, last edit by QuantumEthos at Mar 26, 2019 5:25:32 PM]
[Mar 26, 2019 5:06:37 PM]   Link   Report threatening or abusive post: please login first  Go to top 
QuantumEthos
Senior Cruncher
Joined: Jul 2, 2011
Post Count: 336
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: HPC Community Configuration RS - some advice

[Mar 31, 2019 2:50:41 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 22   Pages: 3   [ Previous Page | 1 2 3 | Next Page ]
[ Jump to Last Post ]
Post new Thread