2020-06-01 kdb+ Project Meeting Minutes

2020-06-01 kdb+ Project Meeting Minutes

Meeting minutes status: Approved (at 2020-07-13 meeting)

 

Table of Contents

Date/Time

  • June 1st, 2020. 10am ET

Attendees

Name

Organisation

Github ID 

Name

Organisation

Github ID 

@Alvin Shih

Morgan Stanley

alvin-c-shih

Aaron Davies

Morgan Stanley

adavies42

Peter Gyorok

Morgan Stanley

gyorokpeter

Andreas Markitanis

Barclays

 

Rob Underwood

FINOS

brooklynrob

 

 

 

Agenda

Time

Item

Who

Notes from the Meeting

Time

Item

Who

Notes from the Meeting

5 min

Convene & roll call.

All

 

5 min

Review and approve minutes from last meeting.

All

  • Minutes approved by acclamation.

5 min

Pull request for .finos.query.renameKeys[...] / .finos.query.renameCols[...]  submitted:

All

  • Request to update with support for keyed tables.

    • Will merge what's there and contributor will update when they face that use case.

10 min

Request for something resembling "Master Table Library" from Business Metrics.

  • Allows load-balanced set of gateways to cache frequently-accessed results from the back end.

  • Useful for making UI more responsive.

  • Simple to create for a single process.

  • Leader using async broadcast to followers is significantly more development effort.

All

  • Existing implementation tied to BMET load balancer implementation.

    • All MS load balancer implementations have been langagaes other than q.  (Java / C++ / Erlang)

    • Previous meetings showed a reluctance to bring in non-q code (eg. Python).

    • -30!x "deferred response" feature from 3.6 opens the door to a pure-q load balancer.

    • See if one gets contributed.

10 min

Barclays involvement with FINOS?

All

20 min

Hard fork for "Studio for kdb+" created:

Try to get the word out to those who've already hacked on it.

Volunteers to review / approve PRs?

Anybody interacted with the IntelliJ plugin maintainer?

All

10 min

RFC for more featureful q IPC protocol?

  • Requirements for encrypted "data in motion"?  (Cloud.)

  • Standard way for client to authenticate the server?

  • Piggyback on some existing protocol?

All

  • Existing protocol supports SSL:

  • Need to review TLS support:

  • Protocol should support:

    • Reporting of connection denied vs. failed.

      • This ambiguity is confusing for load balancers.

    • Two-way handshake.

      • Negotiate strongest common encryption protocol.

      • Client given means to authenticate the server to prevent man-in-the-middle attacks.

  • Morgan Stanley has compiled a wish list.

    • Will need some updating before publishing on FINOS GitHub.

5 min

Anyone played with QDoc?

Gaining traction in your neck of the woods?

Retire finos/qdoc?

All

  • No strong feelings about retiring finos/kdb/qdoc .

    • Leave it for now.

  • Kx Analyst has been conveniently packaged within MS.

    • Will see how much uptake there is of Kx qDoc over time.

5 min

AOB

All

  • Should check in with the AquaQ folks at some point.