Package com.linkedin.davinci.blobtransfer

Class NettyP2PBlobTransferManager

java.lang.Object

com.linkedin.davinci.blobtransfer.NettyP2PBlobTransferManager

All Implemented Interfaces:

BlobTransferManager<Void>, P2PBlobTransferManager<Void>, AutoCloseable

public class NettyP2PBlobTransferManager
extends Object
implements P2PBlobTransferManager<Void>

Netty based P2P blob transfer manager implementation. Upon start, it starts the blob transfer service and the client, so it can receive requests from peers to serve blobs and in the meanwhile, it can make requests to other peers to fetch blobs.

Field Summary

Fields

Modifier and Type	Field	Description
protected final AggVersionedBlobTransferStats	aggVersionedBlobTransferStats
protected final NettyFileTransferClient	nettyClient
protected final BlobFinder	peerFinder

Constructor Summary

Constructors

Constructor	Description
NettyP2PBlobTransferManager(P2PBlobTransferService blobTransferService, NettyFileTransferClient nettyClient, BlobFinder peerFinder, String baseDir, AggVersionedBlobTransferStats aggVersionedBlobTransferStats)

Method Summary

Modifier and Type	Method	Description
void	close()	Close the blob transfer manager and related resources
CompletionStage<InputStream>	get(String storeName, int version, int partition, BlobTransferUtils.BlobTransferTableFormat tableFormat)	Get the blobs for the given storeName and partition
AggVersionedBlobTransferStats	getAggVersionedBlobTransferStats()	Get the blob transfer stats
void	start()	Start the blob transfer manager and related resources

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.linkedin.davinci.blobtransfer.P2PBlobTransferManager

put

Field Details

nettyClient

protected final NettyFileTransferClient nettyClient

aggVersionedBlobTransferStats

protected final AggVersionedBlobTransferStats aggVersionedBlobTransferStats

peerFinder

protected final BlobFinder peerFinder

Constructor Details

NettyP2PBlobTransferManager

public NettyP2PBlobTransferManager(P2PBlobTransferService blobTransferService,
 NettyFileTransferClient nettyClient,
 BlobFinder peerFinder,
 String baseDir,
 AggVersionedBlobTransferStats aggVersionedBlobTransferStats)

Method Details

start

public void start()
           throws Exception

Description copied from interface: BlobTransferManager

Start the blob transfer manager and related resources

Specified by:

start in interface BlobTransferManager<Void>

Throws:

Exception

get

public CompletionStage<InputStream> get(String storeName,
 int version,
 int partition,
 BlobTransferUtils.BlobTransferTableFormat tableFormat)
                                 throws VenicePeersNotFoundException

Description copied from interface: BlobTransferManager

Get the blobs for the given storeName and partition

Specified by:

get in interface BlobTransferManager<Void>

tableFormat - the table format defined in config (PLAIN_TABLE or BLOCK_BASED_TABLE).

Returns:

the InputStream of the blob. The return type is experimental and may change in the future.

Throws:

VenicePeersNotFoundException - when the peers are not found for the requested blob. Other exceptions may be thrown, but it's wrapped inside the CompletionStage.

close

public void close()
           throws Exception

Description copied from interface: BlobTransferManager

Close the blob transfer manager and related resources

Specified by:

close in interface AutoCloseable

Specified by:

close in interface BlobTransferManager<Void>

Throws:

Exception

getAggVersionedBlobTransferStats

public AggVersionedBlobTransferStats getAggVersionedBlobTransferStats()

Get the blob transfer stats

Specified by:

getAggVersionedBlobTransferStats in interface BlobTransferManager<Void>

Returns:

the blob transfer stats