Rob Underwood

FINOS

brooklynrob

@Alvin Shih

Morgan Stanley

alvin-c-shih

Aaron Davies

Morgan Stanley

adavies42

@James McLeod (Unlicensed)

FINOS

mcleo-d

Jonny Press

AquaQ Analytics

jonnypress

Peter Gyorok

Morgan Stanley

gyorokpeter

Tim Beletskiy

JP Morgan

Gary Davies

AquaQ Analytics

drgdavies

5 min

Convene & roll call.

All

5 min

Review and approve minutes from last meeting.

All

• Found some additional notes from last meeting.
  
  

  • Will update and have the vote at the September call.

5 min

"Studio for kdb+" updates.

• Features in the pipeline?

• Icon status?

• FYI: May be viable to incorporate Creative Commons-licensed materials into FINOS projects.

  • FINOS will look at it more closely when the need arises.

All

• Icon designer on vacation.

  • Some internal review / tweaking to take place.

  • Will be released shortly after that.

5 min

FINOS Open Developer Platform.

• Might as well go with minutes in it since it's the way forward.

• Can try to convert non-minutes Wiki content to Markdown with Pandoc.

• Curious about manual override of Attendee List in case:

  • banks block login to GitHub unless named on the CCLA

  • attendees lazy / paranoid about persistent login to GitHub

All

• ODP (i.e., Github Actions Powered) meeting minutes need to be set up by @Maurizio Pillitu and @James McLeod (Unlicensed).

• See this issue, https://github.com/finos/open-developer-platform/issues/161 , which tracks that. 

25 min

MemVerge vs qclone.

• "AquaQuarantine: MemVerge and kdb+" video suggested use cases where MemVerge might be used in a kdb+ plant.

• Shared memory pages sounds like something qclone can do for free without exotic hardware.

• Tease apart the use cases and see if they're interesting enough to put out the qclone plugin and cooperatively develop wrapper functions to support agreed-upon use cases.

• For cases that qclone doesn't work, investigate alternatives such as:

  • https://github.com/trishume/telefork

  • https://github.com/HewlettPackard/criu-pmem

All

• Use cases that attendees found interesting:
  
  

  • Debugging complex memory state with high computation.

  • EOD save down.

  • Snapshot to a file or across a network.

  • Worker processes for heavy compute like feature engineering.

• qclone limitations:

  • Doesn't offer any resilience in the face of host crash.

• Questions:

  • Process management for clones?

  • Containerization?

• Will try to get qclone PoC released for experimentation.

• Discussion pivoted to Cloud.

  • Morgan Stanley and JPMC looking for ways to simplify deployment of kdb+ on the cloud.

  • Tools to manage the cooperating processes typical of a kdb+ plant?

  • FINOS Cloud Service Certification currently more about standards.

    • No actual code.

  • Related links:

    • https://www.wsj.com/articles/morgan-stanley-leads-bank-group-on-cloud-data-standards-11596101401

    • https://github.com/finos/cloud-service-certification/wiki

5 min

AOB

All