You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Kristoffer Sjögren <st...@gmail.com> on 2016/01/12 11:35:52 UTC

Use TCP client for id lookup

Hi

I'm trying to understand how to lookup certain id fields of RDDs to an
external mapping table. The table is accessed through a two-way binary
tcp client where an id is provided and entry returned. Entries cannot
be listed/scanned.

What's the simplest way of managing the tcp client and its connections
towards the external system? I suppose I cannot use the tcp client in
a mapToPair() call?

Cheers,
-Kristoffer

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org