HP Vertica

• HP columnar database. 
• PostgreSQL fork.
• Updates and inserts (even batched) are slow. Bulk loading required.

Tools

• Binaries at opt/vertica/bin and opt/vertica/bin

vsql
adminTools

• SQL frontend: SQuirrel

VM credentials

dbadmin/password
root/password

Example Database
Scripts location: /opt/vertica/examples
Installation: ./install_example VMart 
Verification: launch vsql and select count(1) from store.store_sales_fact;

Singularities

• Columnar
• Compression
• Projections
• Clustering and partitions
• EPOCH (update / insert timestamp) EPOCH (update / insert timestamp)

Bulk loading

• COPY and COPY LOCAL
• Streaming data via JDBC.
• COPY LOCAL from JDBC
• VerticaCopyStream

Tips
https://github.com/jackghm/Vertica/wiki/HP-Vertica-Tips,-Tricks,-and-Best-Practices

D3.js based charts

C3.js
http://c3js.org/

Nvd3
http://nvd3.org/

Britecharts
http://eventbrite.github.io/britecharts/

Notes on Vaadin 8

New features summary
https://vaadin.com/framework/whatsnew
https://dzone.com/articles/21-improvements-in-vaadin-8
https://vaadin.com/download/prerelease/8.0/8.0.0/8.0.0.alpha9/release-notes.html

Grid
Lazy loading: https://vaadin.com/blog/-/blogs/lazy-loading-with-vaadin-8

Forms
Binding: https://vaadin.com/blog/-/blogs/vaadin-8-binder

Icons
FontAwesome deprecated (available as pluggin)
Vaadin icons: https://vaadin.com/icons

Notes on Apache Kafka

http://davewentzel.com/content/kafka-notes/

Clustering
Based on Zookeeper
https://www.quora.com/What-is-the-actual-role-of-ZooKeeper-in-Kafka
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper

Log compaction
Cosumer receives at least the last message of each key.
http://www.shayne.me/blog/2015/2015-06-25-everything-about-kafka-part-2/

JSON serialization
org.apache.kafka.connect.json.JsonConverter
Easier to setup
https://blog.knoldus.com/2017/01/30/kafka-sending-object-as-a-message/

AVRO serialization
io.confluent.connect.avro.AvroConverter
Recommended: schema based, fast, compact, versioning (evolution)
Schema registry needed (Confluent distro)

Schemas are automatically registered by the producers

http://cloudurable.com/blog/avro/index.html
http://cloudurable.com/blog/kafka-avro-schema-registry/index.html
https://www.slideshare.net/JeanPaulAzar1/kafka-and-avro-with-confluent-schema-registry

Compression
GZIP or Snappy
Less bandwitdh and disk space, more CPU resources.

Topics and Partitions
Multiple topics per producer: https://stackoverflow.com/questions/21376715/how-many-producers-to-create-in-kafka

Distributions

• Confluent: http://docs.confluent.io/current/
• Schema registry, REST proxy, connectors, ...
• Windows scripts don't work but fixed versions of all of them can be found at https://github.com/renukaradhya/confluentplatform
• CentOS systemd unit files: https://avsej.net/2016/systemd-units-for-confluent-connect-on-fedora-24
• Landoop http://www.landoop.com/kafka/kafka-tools/
• Docker images, Web tools, connectors, ...

Producer
http://cloudurable.com/blog/kafka-tutorial-kafka-producer-advanced-java-examples/index.html