diff --git a/source/bundles_overview.rst b/source/bundles_overview.rst index 13f75231..0d4a404f 100644 --- a/source/bundles_overview.rst +++ b/source/bundles_overview.rst @@ -56,6 +56,1010 @@ Current list of available bundles: +<<<<<<< HEAD + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Bundle NameStatusDescription
+ bat + ACTIVE +

Provides the neccesary bundles to perform BAT succesfully

+
  • Includes (devtools-basic) bundle.

    +
  • Includes (openstack-test-suite) bundle.

    +
  • Includes (os-testsuite) bundle.

    +
  • Includes (pnp-tools-advanced) bundle.

    +
  • Includes (openstack-all-in-one) bundle.

    +
  • Includes (storage-utils) bundle.

    +
    • + bootloader + ACTIVE +

    UEFI bootloaders

    +
    + cloud-control + WIP +

    Support packages for a cloud control surface

    +
  • Includes (os-utils) bundle.

    +
  • Includes (kvm-host) bundle.

    +
  • Includes (net-utils) bundle.

    +
    • + clr-devops + ACTIVE +

    Provides build/release tools for Clear devops team

    +
    + containers-basic + WIP +

    Installs rkt base for Clear Containers

    +
  • Includes (storage-utils) bundle.

    +
  • Includes (network-basic) bundle.

    +
  • Includes (kernel-container) bundle.

    +
    • + cryptography + ACTIVE +

    Cryptographic tools

    +
    + database-mariadb + ACTIVE +

    Provides components needed to run MariaDB

    +
    + database-mariadb-dev + ACTIVE +

    Provides MariaDB development tools (libraries and drivers)

    +
  • Includes (database-mariadb) bundle.

    +
    • + database-mongodb + WIP +

    Provides components needed to run mongodb

    +
    + devtools-basic + ACTIVE +

    Provides basic set of languages and tools for development

    +
  • Includes (R-basic) bundle.

    +
  • Includes (go-basic) bundle.

    +
  • Includes (hpc-basic) bundle.

    +
  • Includes (os-core-dev) bundle.

    +
  • Includes (perl-basic) bundle.

    +
  • Includes (python-basic) bundle.

    +
  • Includes (ruby-basic) bundle.

    +
    • + devtools-extras + ACTIVE +

    Provides extra set of languages and tools for development

    +
  • Includes (R-extras) bundle.

    +
  • Includes (devtools-basic) bundle.

    +
  • Includes (go-extras) bundle.

    +
  • Includes (perl-extras) bundle.

    +
  • Includes (python-extras) bundle.

    +
  • Includes (ruby-extras) bundle.

    +
    • + dev-utils + ACTIVE +

    Provides a limited set of development utilities

    +
    + dpdk-dev + ACTIVE +

    All headers and libraries necessary to develop with the Data Plane Development Kit.

    +
  • Includes (os-core-dev) bundle.

    +
    • + editors + ACTIVE +

    Provides popular text editors

    +
    + file-utils + ACTIVE +

    Provides basic set of file manipulation utilities

    +
    + Games + ACTIVE +

    A colossal, but entertaining waste of time

    +
    + go-basic + ACTIVE +

    Provides basic Go language development

    +
    + go-extras + ACTIVE +

    Most popular Golang libraries

    +
  • Includes (go-basic) bundle.

    +
    • + hpc-basic + ACTIVE +

    Provides basic suite of MPI/HPC development tools

    +
  • Includes (os-core-dev) bundle.

    +
    • + internet-console-utils + WIP +

    Includes internet console tools to interact with internet

    +
    + iot + WIP +

    The IoT (Internet of Things) base bundle

    +
  • Includes (kernel-embedded) bundle.

    +
    • + java-basic + ACTIVE +

    Provides all openjdk tools

    +
    + kernel-container + WIP +

    Provides a Linux kernel appropriate for a Clear Container

    +
    + kernel-embedded + ACTIVE +

    Provides a Linux kernel appropriate for embedded devices

    +
  • Includes (bootloader) bundle.

    +
    • + kernel-kvm + ACTIVE +

    Provides a Linux kernel appropriate for running under KVM

    +
  • Includes (bootloader) bundle.

    +
    • + kernel-native + ACTIVE +

    Provides a Linux kernel appropriate for physical machines

    +
  • Includes (bootloader) bundle.

    +
    • + kernel-pxe + ACTIVE +

    Provides a Linux kernel linking an initramfs as root

    +
    + koji + WIP +

    Sets up a koji build service (builder-only, for now) based on NFS mounts.

    +
    + kvm-host + WIP +

    Provides necessary tools to run usable virtual machines with QEMU-KVM (independently of OpenStack).

    +
  • Includes (kernel-kvm) bundle.

    +
    • + lamp-basic + ACTIVE +

    Basic LAMP Server (apache2, mariadb, php5)

    +
    + mail-utils + WIP +

    Provides utilities for reading and sending email

    +
    + message-broker-rabbitmq + ACTIVE +

    Provides the RabbitMQ messaging service

    +
    + mixer + WIP +

    Provide required utilities to make derivative releases

    +
    + net-utils + ACTIVE +

    Provides an essential suite of core networking configuration and debug tools

    +
    + network-advanced + WIP +

    More utilities for advanced host-level networking; bridge, switch, netfilter, vpn etc.

    +
    + network-basic + ACTIVE +

    Provides a basic suite of networking utilities

    +
    + network-proxy-client + WIP +

    Tools for dealing with client-side network proxy settings.

    +
    + nfs-utils + WIP +

    Provides NFS binaries, associated utilities, and tools. Currently only client services are fully supported.

    +
    + opencontainers-dev + WIP +

    Includes required components for developing against the Open Container Specification

    +
  • Includes (go-basic) bundle.

    +
    • + openssh-server + ACTIVE +

    Provides an SSH server (and client)

    +
    + openstack-all-in-one + WIP +

    Provides an All-in-one OpenStack deployment

    +
  • Includes (database-mariadb) bundle.

    +
  • Includes (database-mongodb) bundle.

    +
  • Includes (message-broker-rabbitmq) bundle.

    +
  • Includes (openstack-block-storage) bundle.

    +
  • Includes (openstack-block-storage-controller) bundle.

    +
  • Includes (openstack-compute) bundle.

    +
  • Includes (openstack-compute-controller) bundle.

    +
  • Includes (openstack-dashboard) bundle.

    +
  • Includes (openstack-data-processing) bundle.

    +
  • Includes (openstack-database) bundle.

    +
  • Includes (openstack-identity) bundle.

    +
  • Includes (openstack-image) bundle.

    +
  • Includes (openstack-lbaas) bundle.

    +
  • Includes (openstack-network) bundle.

    +
  • Includes (openstack-object-storage) bundle.

    +
  • Includes (openstack-orchestration) bundle.

    +
  • Includes (openstack-python-clients) bundle.

    +
  • Includes (openstack-telemetry) bundle.

    +
  • Includes (openstack-vpnaas) bundle.

    +
    • + openstack-block-storage + WIP +

    Provides an OpenStack Cinder service

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-block-storage-controller + WIP +

    Provides an OpenStack Cinder controller service

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-common + WIP +

    common components for OpenStack functionalit

    +
  • Includes (python-basic) bundle.

    +
    • + openstack-compute + WIP +

    Provides an OpenStack nova-compute node

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-compute-controller + WIP +

    Provides an OpenStack Nova control server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-configure + WIP +

    Provides a suggested default configuration for OpenStack on Clear Linux.

    +
    + openstack-controller + WIP +

    Provides an OpenStack multi-service control server

    +
  • Includes (database-mariadb) bundle.

    +
  • Includes (message-broker-rabbitmq) bundle.

    +
  • Includes (openstack-identity) bundle.

    +
  • Includes (openstack-image) bundle.

    +
  • Includes (openstack-compute-controller) bundle.

    +
  • Includes (openstack-dashboard) bundle.

    +
  • Includes (openstack-python-clients) bundle.

    +
    • + openstack-dashboard + WIP +

    Provides an OpenStack Horizon server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-database + WIP +

    Provides a Database as a Service server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-data-processing + WIP +

    Provides a simple means to provision a data-intensive application cluster

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-identity + WIP +

    Provides an OpenStack Keystone server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-image + WIP +

    Provides an OpenStack Glance server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-lbaas + WIP +

    Provides Load Balancing as a Service

    +
  • Includes (openstack-common) bundle.

    +
  • Includes (openstack-network) bundle.

    +
    • + openstack-network + WIP +

    Provides an OpenStack Neutron server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-object-storage + WIP +

    Provides an OpenStack Swift service

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-orchestration + WIP +

    Provides an OpenStack Heat service

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-python-clients + WIP +

    Provides OpenStack command-line utilities

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-telemetry + WIP +

    Provides an OpenStack Telemetry server

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-telemetry-controller + Deprecated +

    Provides an OpenStack Telemetry server

    +
  • Includes (openstack-telemetry) bundle.

    +
    • + openstack-test-suite + WIP +

    Provides an OpenStack Tempest/test suite

    +
  • Includes (openstack-common) bundle.

    +
    • + openstack-vpnaas + WIP +

    Provides VPN as a Service

    +
  • Includes (openstack-common) bundle.

    +
  • Includes (openstack-network) bundle.

    +
    • + os-cloudguest + WIP +

    Provides clr-cloud-init cloud guest configuration utilities

    +
  • Includes (openssh-server) bundle.

    +
  • Includes (telemetrics) bundle.

    +
    • + os-cloudguest-cci + WIP +

    Retired bundle - now provided by os-cloudguest

    +
  • Includes (os-cloudguest) bundle.

    +
    • + os-clr-on-clr + WIP +

    content for development of the Clear Linux OS on the Clear Linux OS

    +
  • Includes (os-dev-extras) bundle.

    +
  • Includes (mail-utils) bundle.

    +
  • Includes (storage-utils) bundle.

    +
  • Includes (os-core-update) bundle.

    +
    • + os-core + ACTIVE +

    The basic core OS components of Clear Linux for iA

    +
    + os-core-dev + ACTIVE +

    Basic development tools

    +
    + os-core-update + ACTIVE +

    Provides basic suite for running the Clear Linux for iA Updater

    +
  • Includes (os-core) bundle.

    +
    • + os-dev-extras + ACTIVE +

    Additional C/C++ development packages (beyond os-core-dev)

    +
    + os-dev-full + WIP +

    A bundle containing all development libraries and headers

    +
    + os-installer + ACTIVE +

    Provides an installer for Clear Linux for iA

    +
  • Includes (telemetrics) bundle.

    +
  • Includes (network-proxy-client) bundle.

    +
    • + os-testsuite + WIP +

    Provides basic test suite for Clear Linux for iA

    +
    + os-testsuite-phoronix + ACTIVE +

    All the required pieces for running the Phoronix Test Suite

    +
  • Includes (os-utils) bundle.

    +
  • Includes (devtools-extras) bundle.

    +
  • Includes (lamp-basic) bundle.

    +
    • + os-utils + ACTIVE +

    Provides a core set of OS utilities

    +
  • Includes (editors) bundle.

    +
  • Includes (dev-utils) bundle.

    +
  • Includes (sysadmin-basic) bundle.

    +
  • Includes (network-basic) bundle.

    +
  • Includes (file-utils) bundle.

    +
  • Includes (network-proxy-client) bundle.

    +
  • Includes (internet-console-utils) bundle.

    +
    • + os-utils-gui + ACTIVE +

    Provides a graphical desktop environment

    +
  • Includes (os-utils) bundle.

    +
    • + perl-basic + ACTIVE +

    Provides essential Perl language and dev tools

    +
    + perl-extras + ACTIVE +

    Provides extra libraries for Perl

    +
  • Includes (perl-basic) bundle.

    +
    • + pnp-tools-advanced + WIP +

    Provides advanced Power and Performance measurement tools

    +
  • Includes (pnp-tools-intermediate) bundle.

    +
    • + pnp-tools-basic + WIP +

    Provides basic Power and Performance testing tools

    +
    + pnp-tools-intermediate + WIP +

    Provides a deeper-level suite of Power and Performance testing tools

    +
  • Includes (pnp-tools-basic) bundle.

    +
    • + pxe-server + ACTIVE +

    All the bits to run a PXE server for Clear Linux

    +
    + python-basic + ACTIVE +

    Provides core Python language and libraries

    +
    + python-extras + ACTIVE +

    Provides extra libraries for Python

    +
  • Includes (python-basic) bundle.

    +
    • + R-basic + ACTIVE +

    Provides core R language and libraries

    +
    + R-extras + ACTIVE +

    Provides deeper functionality R language libraries

    +
  • Includes (R-basic) bundle.

    +
    • + ruby-basic + ACTIVE +

    Top 3 basic Ruby Libraries

    +
    + ruby-extras + ACTIVE +

    Top 3 to 6 basic Ruby Libraries

    +
  • Includes (ruby-basic) bundle.

    +
    • + rust-basic + ACTIVE +

    rust compiler and cargo packaging tool

    +
    + shells + ACTIVE +

    All available shell programs for Clear, along with ancillary files

    +
    + storage-cluster + WIP +

    Ceph Cluster Storage

    +
    + storage-utils + ACTIVE +

    Provides basic storage-related utilities

    +
    + sysadmin + ACTIVE +

    Moved to sysadmin-basic

    +
  • Includes (sysadmin-basic) bundle.

    +
    • + sysadmin-advanced + ACTIVE +

    Toolchest that a sysadmin needs to diagnose issues

    +
  • Includes (sysadmin-basic) bundle.

    +
  • Includes (pnp-tools-advanced) bundle.

    +
    • + sysadmin-basic + ACTIVE +

    Provides a basic set of system administration utilities.

    +
    + sysadmin-hostmgmt + WIP +

    Utilities and Services for managing large-scale clusters of networked hosts

    +
  • Includes (os-utils) bundle.

    +
  • Includes (pxe-server) bundle.

    +
    • + tcl-basic + WIP +

    Components related to the TCL interpreter and associated tools

    +
    + telemetrics + ACTIVE +

    Provides the Telemetrics client for Clear Linux for iA

    +
    + virtualbox-guest + ACTIVE +

    Include the modules and binaries meant to be used as a VirtualBox instance

    +
    +======= Bundle Name Status @@ -912,4 +1916,5 @@ Current list of available bundles:

    Include the modules and binaries meant to be used as a VirtualBox instance

    - \ No newline at end of file + +>>>>>>> f2d91732d57ed248f417c926377da86d0a7103ae diff --git a/source/ciao-cluster-setup.rst b/source/ciao-cluster-setup.rst index c2e04648..eb7f0ed6 100644 --- a/source/ciao-cluster-setup.rst +++ b/source/ciao-cluster-setup.rst @@ -168,6 +168,35 @@ The controller node will host your controller and scheduler. Certificates are as to be in ``/etc/pki/ciao``, generated with the correct roles and names as previously described. +Cluster Configuration +~~~~~~~~~~~~~~~~~~~~~ +Ciao's cluster configuration is stored and fetched from a cluster specific storage backend. +Supported backends are plain **local file**, **etcd** [WIP] and **ZooKeeper** [WIP]. + +For more details about Cluster Configuration Architecture: `CIAO Configuration Architecture`_ + +- Local File backend + + - Create the ``/etc/ciao/configuration.yaml`` file. Example:: + + configure: + scheduler: + storage_uri: /etc/ciao/configuration.yaml + controller: + compute_ca: /etc/pki/ciao/compute_ca.pem + compute_cert: /etc/pki/ciao/compute_key.pem + identity_user: controller + identity_password: ciao + launcher: + compute_net: 192.168.1.110 + mgmt_net: 192.168.1.111 + image_service: + url: http://glance.example.com + identity_service: + url: http://keystone.example.com + + - More examples at: `CIAO Configuration examples`_ + Scheduler ~~~~~~~~~ @@ -245,7 +274,7 @@ The launcher is run with options declaring certificates, maximum VMs available on your node), server location, and compute node ("cn") launching type. For example:: - $ sudo ./ciao-launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-CNAgent-localhost.pem --server= --network=cn --compute-net --mgmt-net + $ sudo ./ciao-launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-CNAgent-localhost.pem --network=cn Optionally, add ``-logtostderr`` (more verbose with also ``-v=2``) to get console logging output. @@ -282,7 +311,7 @@ The network node's launcher is run similarly to the compute node's launcher. The primary difference is that it uses the network node ("nn") launching type:: - $ sudo ./ciao-launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-NetworkingAgent-localhost.pem --server= --network=nn --compute-net --mgmt-net + $ sudo ./ciao-launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-NetworkingAgent-localhost.pem --network=nn Start the controller -------------------- @@ -319,10 +348,6 @@ CNCI). To run other images of your choosing, follow a process similar to the above: pre-populate OS images and edit each of these two files on your controller node. -If the controller is on the same physical machine as the scheduler, the -``--url`` option is optional; otherwise it refers to your scheduler -SSNTP server IP. - In order for the ciao-controller's go code to correctly use the CA certificate(s) generated earlier when you built your keystone server, this certificate needs to be installed in the control node and be @@ -347,7 +372,7 @@ name of the system that is hosting the keystone service**. An SSL-enabled Keystone is required, with additional parameters for ciao-controller pointing at its certificates:: - $ sudo ./ciao-controller --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-Controller-localhost.pem -identity=https://[keystone-FQDN]:35357 --username= --password= --url --httpskey=./key.pem --httpscert=./cert.pem + $ sudo ./ciao-controller --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-Controller-localhost.pem Optionally add ``-logtostderr`` (more verbose with also ``-v=2``) to get console logging output. @@ -468,7 +493,7 @@ On the node running your keystone VM, run the following command:: On the network node, run the following commands:: - $ sudo ./launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-NetworkingAgent-localhost.pem --server= --network=nn --compute-net --mgmt-net --hard-reset + $ sudo ./launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-NetworkingAgent-localhost.pem --network=nn $ sudo killall -9 qemu-system-x86_64 $ sudo rm -rf /var/lib/ciao/instances/ $ sudo reboot @@ -476,7 +501,7 @@ On the network node, run the following commands:: If you were unable to successfully delete all workload VM instances through the UI, then on each compute node run these commands:: - $ sudo ./launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-CNAgent-localhost.pem --server= --network=cn --compute-net --mgmt-net --hard-reset + $ sudo ./launcher --cacert=/etc/pki/ciao/CAcert-[scheduler-node-hostname].pem --cert=/etc/pki/ciao/cert-CNAgent-localhost.pem --network=cn $ sudo killall -9 qemu-system-x86_64 $ sudo docker rm $(sudo docker ps -qa) $ sudo docker network rm $(sudo docker network ls -q -f "type=custom") @@ -534,3 +559,5 @@ testing. .. _mailing list: https://lists.clearlinux.org/mailman/listinfo/ciao-devel .. _ciao-cli: https://github.com/01org/ciao/tree/master/ciao-cli .. _ciao-webui: https://github.com/01org/ciao-webui +.. _CIAO Configuration Architecture: https://github.com/01org/ciao/wiki/Configuration +.. _CIAO Configuration Examples: https://github.com/01org/ciao/tree/master/configuration#configuration-examples