Open Source Packages on IBM Linux on Power-LE February 2016 Eberhard Saemann [email protected] Open Source Ecosystem Dev. Env /Tools Available: Angular.js,Backbone, Bootstrap, buildbot, busyBox, Continuum, CruiseControl, Docker , Eigen lib, Erlang, Ganglia, GCC, gccgo, GDB, GoLang, Gump, Jenkins, Jruby, Lynx, LLVM, logstash, logstashforwarder, kibana, Maven, Nagios, NGINX, node.js, OCaml, OpenJDK, Phantom.js, PHP, phpMy Admin, Perl, PyCi, Python, PythonDjango, Python-Pip ecosystem, PyPy, R, RabitMQ, rsyslog, Ruby, Ruby on Rails (rbenv), Ruby Gems, scala, snappy, Socket.io (npmjs), SpiderMonkey, Strider, Supervisord, SystemTap, Vagrant, V8, Xerces Databases Big Data & Analytics Available: Accumulo (column), Cassandra CouchDB (document) Couchbase (noSQL) Derby, MariaDB (v10.x optimized), EnterpriseDB Memcached (KVS) MongoDB 3.2 (document) MySQL, PostgreSQL, RabbitMQ Redis (KVS), Riak, SQLite TokyoCabinet Virtuoso (graph) Available: Hadoop Base, Hive, HBase, Accumolo, Ambari, Avro, ElasticSearch Falcon, FluentD Flume, Hue, Kafka, Knox, Lucene-Solr, Mahout, Oozie, Parquet, Phoenix Pig, Ranger, Slider, Spark, Sqoop, Storm, Tez, Zookeeper Port In Progress: GPUDB, Neo4j (graph), Optimizing: Hadoop Optimizing: PostgresSQL (1.86x) CouchDB Evaluating: InfiniSQL Optimized: R Port In Progress: Travis-CI © 2016 International Business Machines Corporation Cloud Managemnt Stack Available: Apache Web Server Apache tomcat Ceph, Chef Client, Glassfish, Jetty, Juju & Juju gui Landscape client MAAS, OpenStack, Puppet Apache Qpid Thrift Ceilometer client, Sensu Server & Client Port In Progress: Chef Server v12 Evaluating: Clusterpoint Other HA, Security etc. Available: Alfresco, BTRFS, Bootstrap CentOS Chroma-key Cluster Glue, corosync, CRMshell, DRBD Evolution data svr, ClusterGlue, HAProxy, Heartbeat keepalived Ldirectord, Linux-HA. mesos OpenSSL Pacemaker, REAR, resource agents, Samba, Tophat WordPress Port In Progress: Available: Open source application is ported and available on distro (Ubuntu or RHEL or SLES) (black), in community (purple), Lab7 (green) or Veristorm (orange). Does not mean it is optimized. Does not mean that a commercial ISV version is available. Evaluating: Needs to be vetted in new business development prioritization process. Some of these are available codes that need optimization to be competitive with x86. Evaluating: Cluster-Network Open Identity Stack (forgerock.com) Technical Computing Available: ALLPATH-LG, bfast, BioConductor, BLAST, BOOST, Bowtie2, BWA, EMBOSS, FASTA, FastQC, HMMER, HTSeq, ISAAC, PICARD, PLINK, RNAStar, RSEM, SAMTools, SAMTools 1.0, SeqAn, SHRiMP, SOAPAligner, SOAPbuilder, SOAPDenovo, TMAP, TopHat, ABySS, Balsa, Caffe, CodeSaturne, GATK, GMP, Heat3d, IOR, Lattice-Boltzmann, LAPACK, OpenFOAM, waterman …. Optimized & GPU enabled: AMBER14, CHARMM, Galaxy, GAMESS, GROMACS, HPCchallenge, KKRnano, LatticQCD, MAFIA, NAMD. NEST, PEASOUP, PLUTO, Quantum Espresso, QUDA, SOAP3-DP, WRF Evaluating: ALYA, CEGMA, DIALIGN-TX, MUSCLE, openQCD, RSEM, SIFT, STREAM, T-Coffee, miRdeep2, ucsctools, ViennaRNA, 2 Available Technical Computing Packages ABySS, ALLPATHS-LG, ALYA, Amber14, ATLAS Lattice-Boltzmann, LatticeQCD (LQCD), LAPACK BAMtools, Barracuda, bedtools, bfast, (liblapack3), LES, LSQR, LibGD<partially>, libpng, Ludwig BioConductor, BLAS (libblas3), BLAST (NCBI), Boost, MAFIA, Matplotlib, Mdtest, MG2, Mothur, MPAS-A, Bowtie, Bowtie2, BWA, bzip2 MurmurHash, Caffe, c-ares, CHARMM, ClustalW, Code-Saturne, NAMD, NEST, nlopt, nose (Python), NumPy, NWChem, CoMD (LJForce), Cosmo SVN, CP2k, CPMD, Oases, OpenARC, OpenFOAM, OpenQCD, Cufflinks EBSEQ (R), Eigen (eigenlib), EMBOSS, Eureka, Eureka-client, FASTA, FastQC, fftw (vectorized), Galaxy, GAMESS, GATK, GMP, gnuplot, Graphviz, GROMACS, Heat3d, HMMER, HOMM-COMM, HPC Challenge (incl. Linpack HPL), HPCG, HPL, HTSeq, Htslib, IGV, IOR, iRODS (beta), iSSAC (Illumina), Jurrassic, KKRnano © 2016 International Business Machines Corporation PEASOUP, PICARD, PIConGPU, PLINK, PLUTO. POPPPerf, Pysam. PyReshaper QuantumEspresso, QUDA R, regCM. RNAStar, RSEM SAMtools, Scalpel, SeqAn, SHOC, SHRiMP, SOAP3-DP, SOAPAligner/SOAP2, SOAPbuilder, SOAPdenovo2, spice, SQLite, STREAM tabix, TMAP, TopHat, Trinity VASP, variant_tools, Velvet/Oases, native vector support libs, Waterman, WRF 3 Hadoop Packages package name Hadoop base 14.04+ SLES 12 RHEL 7.1 LE RHEL 7.1 LE comment 2.4.1 2.4.1 2.4.1 2.7.1 HDFS, MapReduce, YARN UBUNTU Accumulo package name UBUNTU 14.04+ SLES 12 RHEL 7.1 LE RHEL 7.1 LE Slider 0.80.0 1.5.1 Spark 1.4.1 Ambari 1.6.0 1.6.0 1.6.0 1.6.0 Sqoop 1.4.6 Avro 1.7.4 1.7.4 1.7.4 1.7.4 Storm 0.9.3 0.5.0 Tez 1.4.6 1.5.0 ZooKeeper Falcon Flume 1.5.0 1.5.0 1.5.0 HBase 0.98.0 0.98.0 0.98.0 0.98.0 Hive / HCatalog 0.13.0 0.13.0 0.13.0 0.13.0 3.6 3.6 Hue 3.6 3.6 Kafka 0.8.2.1 Knox 0.6.0 Lucene-Solr 4.8.0 4.8.0 4.8.0 Mahout Oozie 4.0.0 4.0.0 4.0.0 4.1 4.0.0 http://repo.veristorm.com/VDH-InstallGuide.pdf 0.4.0 0.14.0 0.14.0 Ranger IBM Open Platform with Apache Hadoop http://www.veristorm.com/veristorm-data-hub 2.3.0 0.14.0 3.4.5 0.9.0 Parquet-Format 0.14.0 3.4.5 Hadoop packages on VeriStorm.com 1.6.0 Pig 3.4.5 4.8.0 Parquet-mr Phoenix 3.4.5 0.4.0 comment Includes Hadoop 2.7.1 & Spark 1.4.1 Hadoop packages (IBM developerWorks) https://www.ibm.com/developerworks/community/wikis/home?la ng=en#!/wiki/W51a7ffcf4dfd_4b40_9d82_446ebc23c550/page/I BM%20Linux%20on%20Power%20Software%20%20Mongodb%2C%20Nodejs%2C%20V8%2C%20Hadoop%2 C%20Cassandra%2C%20etc Package availability: orange = Veristorm Data Hub, purple = open source © 2016 International Business Machines Corporation 4 More Information Lab7 package info http://biobuilds.org/tools-in-biobuilds/biobuilds-2/ Hadoop packages on VeriStorm.com http://www.veristorm.com/veristorm-data-hub http://repo.veristorm.com/VDH-InstallGuide.pdf Hadoop packages (IBM devWorks) https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/W51a7ffcf4dfd_4b40_9d82_446ebc23c550/page /IBM%20Linux%20on%20Power%20Software%20%20Mongodb%2C%20Nodejs%2C%20V8%2C%20Hadoop%2C%20Cassandra%2C%20etc Open Source Packages on IBM DeveloperWorks https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/W51a7ffcf4dfd_4b40_9d82_446ebc23c550/page/IBM%20 Linux%20on%20Power%20-%20Open%20Source%20Software UBUNTU package search (Trusty, 14.04) https://launchpad.net/ubuntu/trusty/+search?text=MariaDB © 2016 International Business Machines Corporation 5