Package org.apache.giraph.conf

Class ImmutableClassesGiraphConfiguration<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>

java.lang.Object

org.apache.hadoop.conf.Configuration

org.apache.giraph.conf.GiraphConfiguration

org.apache.giraph.conf.ImmutableClassesGiraphConfiguration<I,V,E>

Type Parameters:

I - Vertex id

V - Vertex data

E - Edge data

All Implemented Interfaces:

Iterable<Map.Entry<String,String>>, GiraphConstants, org.apache.hadoop.io.Writable

public class ImmutableClassesGiraphConfiguration<I extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable,E extends org.apache.hadoop.io.Writable>
extends GiraphConfiguration

The classes set here are immutable, the remaining configuration is mutable. Classes are immutable and final to provide the best performance for instantiation. Everything is thread-safe.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.conf.Configuration

org.apache.hadoop.conf.Configuration.DeprecationDelta, org.apache.hadoop.conf.Configuration.IntegerRanges

Field Summary

Fields inherited from interface org.apache.giraph.conf.GiraphConstants

ADDITIONAL_EDGE_REQUEST_SIZE, ADDITIONAL_MSG_REQUEST_SIZE, ADDITIONAL_VERTEX_REQUEST_SIZE, AGGREGATOR_BASE_SERVER_PORT, AGGREGATOR_WRITER_CLASS, ASYNC_MESSAGE_STORE_THREADS_COUNT, AUTHENTICATE, BASE_ZNODE_KEY, CHANNELS_PER_SERVER, CHECKPOINT_COMPRESSION_CODEC, CHECKPOINT_DIRECTORY, CHECKPOINT_FREQUENCY, CHECKPOINT_SUPPORTED_CHECKER, CLEANUP_CHECKPOINTS_AFTER_SUCCESS, CLIENT_RECEIVE_BUFFER_SIZE, CLIENT_SEND_BUFFER_SIZE, clientCacheSize, COMPUTATION_CLASS, COMPUTATION_FACTORY_CLASS, COMPUTATION_LANGUAGE, CREATE_EDGE_SOURCE_VERTICES, CREATE_EDGE_SOURCE_VERTICES_CALLBACK, DEFAULT_ZOOKEEPER_MAX_CLIENT_CNXNS, DEFAULT_ZOOKEEPER_SNAP_COUNT, DEFAULT_ZOOKEEPER_TICK_TIME, DISABLE_GIRAPH_CLASS_RESOLVER, DNS_INTERFACE, DNS_NAMESERVER, DO_OUTPUT_DURING_COMPUTATION, EDGE_INPUT_FILTER_CLASS, EDGE_INPUT_FORMAT_CLASS, EDGE_MANAGER, EDGE_OUTPUT_FORMAT_CLASS, EDGE_OUTPUT_FORMAT_SUBDIR, EDGE_STORE_FACTORY_CLASS, EDGE_TRANSLATION_CLASS, EDGE_VALUE_CLASS, EDGE_VALUE_FACTORY_CLASS, EVENT_WAIT_MSECS, FAIL_FIRST_IPC_PORT_BIND_ATTEMPT, FAIL_ON_EMPTY_INPUT, GC_OBSERVER_CLASSES, GIRAPH_TEXT_OUTPUT_FORMAT_REVERSE, GIRAPH_TEXT_OUTPUT_FORMAT_SEPARATOR, GIRAPH_YARN_CONF_FILE, GIRAPH_YARN_LIBJARS, GIRAPH_YARN_PRIORITY, GIRAPH_YARN_TASK_HEAP_MB, GIRAPH_YARN_TASK_HEAP_MB_DEFAULT, GRAPH_PARTITIONER_FACTORY_CLASS, GRAPH_TYPE_LANGUAGES, GRAPH_TYPES_NEEDS_WRAPPERS, HADOOP_OUTPUT_FORMAT_CLASS, HALT_INSTRUCTIONS_WRITER_CLASS, HDFS_FILE_CREATION_RETRIES, HDFS_FILE_CREATION_RETRY_WAIT_MS, INCOMING_MESSAGE_VALUE_CLASS, INET_ADDRESS_MAX_RESOLVE_TIMES, INPUT_SPLIT_MAX_EDGES, INPUT_SPLIT_MAX_VERTICES, INPUT_SPLIT_SAMPLE_PERCENT, INPUT_VERTEX_EDGES_CLASS, INPUT_VERTEX_EDGES_FACTORY_CLASS, IPC_INITIAL_PORT, IS_PURE_YARN_JOB, JMAP_ENABLE, JMAP_LIVE_ONLY, JMAP_PATH, JMAP_PRINT_LINES, JMAP_SLEEP_MILLIS, JOB_OBSERVER_CLASS, JOB_PROGRESS_TRACKER_CLIENT_CLASS, JOB_PROGRESS_TRACKER_SERVICE_CLASS, JOB_RETRY_CHECKER_CLASS, KEEP_ZOOKEEPER_DATA, LB_MAPPINGSTORE_LOWER, LB_MAPPINGSTORE_UPPER, LOCAL_TEST_MODE, LOG_LEVEL, LOG_THREAD_LAYOUT, MAPPER_OBSERVER_CLASSES, MAPPING_INPUT_FORMAT_CLASS, MAPPING_STORE_CLASS, MAPPING_STORE_OPS_CLASS, MASTER_COMPUTE_CLASS, MASTER_OBSERVER_CLASSES, MAX_ALLOWED_JOB_TIME_MS, MAX_CONN_TRY_ATTEMPTS, MAX_COUNTER_WAIT_MSECS, MAX_EDGE_REQUEST_SIZE, MAX_FRAME_LENGTH, MAX_IPC_PORT_BIND_ATTEMPTS, MAX_MASTER_SUPERSTEP_WAIT_MSECS, MAX_MSG_REQUEST_SIZE, MAX_MUTATIONS_PER_REQUEST, MAX_NUMBER_OF_SUPERSTEPS, MAX_OUT_MSG_CACHE_SIZE, MAX_PARTITIONS_IN_MEMORY, MAX_REQUEST_MILLISECONDS, MAX_RESOLVE_ADDRESS_ATTEMPTS, MAX_TASK_ATTEMPTS, MAX_VERTEX_REQUEST_SIZE, MAX_WORKERS, MESSAGE_AGGREGATE_SIZE, MESSAGE_COMBINER_CLASS, MESSAGE_ENCODE_AND_STORE_TYPE, MESSAGE_MANAGER_BASE_SERVER_PORT, MESSAGE_MANAGER_TYPE, MESSAGE_STORE_FACTORY_CLASS, METRICS_DIRECTORY, METRICS_ENABLE, MIN_FREE_MBS_ON_HEAP, MIN_PARTITIONS_PER_COMPUTE_THREAD, MIN_PERCENT_RESPONDED, MIN_WORKERS, MSG_NUM_FLUSH_THREADS, NETTY_CLIENT_EXECUTION_AFTER_HANDLER, NETTY_CLIENT_EXECUTION_THREADS, NETTY_CLIENT_THREADS, NETTY_CLIENT_USE_EXECUTION_HANDLER, NETTY_COMPRESSION_ALGORITHM, NETTY_MAX_CONNECTION_FAILURES, NETTY_REQUEST_ENCODER_BUFFER_SIZE, NETTY_SERVER_BOSS_THREADS, NETTY_SERVER_EXECUTION_AFTER_HANDLER, NETTY_SERVER_EXECUTION_THREADS, NETTY_SERVER_THREADS, NETTY_SERVER_USE_EXECUTION_HANDLER, NETTY_SERVER_WORKER_THREADS, NETTY_SIMULATE_FIRST_REQUEST_CLOSED, NETTY_SIMULATE_FIRST_RESPONSE_FAILED, NETTY_USE_DIRECT_MEMORY, NETTY_USE_POOLED_ALLOCATOR, NUM_CHECKPOINT_IO_THREADS, NUM_COMPUTE_THREADS, NUM_INPUT_THREADS, NUM_OUT_OF_CORE_THREADS, NUM_OUTPUT_THREADS, ONE_KB, ONE_MB, OUT_MESSAGE_CACHE_TYPE, OUT_OF_CORE_DATA_ACCESSOR, OUT_OF_CORE_ORACLE, OUTGOING_MESSAGE_VALUE_CLASS, OUTGOING_MESSAGE_VALUE_FACTORY_CLASS, PARTITION_CLASS, PARTITION_COUNT_MULTIPLIER, PARTITION_LONG_TAIL_MIN_PRINT, PARTITION_VERTEX_KEY_SPACE_SIZE, PARTITIONS_DIRECTORY, PREFER_IP_ADDRESSES, REACTIVE_JMAP_ENABLE, REQUEST_SIZE_WARNING_THRESHOLD, RESEND_TIMED_OUT_REQUESTS, RESOLVER_CREATE_VERTEX_ON_MSGS, RESTART_JOB_ID, RESTART_SUPERSTEP, SERVER_RECEIVE_BUFFER_SIZE, SERVER_SEND_BUFFER_SIZE, SPLIT_MASTER_WORKER, SSL_ENCRYPT, STATIC_GRAPH, SUPERSTEP_COUNT, TCP_BACKLOG, TRACK_JOB_PROGRESS_ON_CLIENT, TYPES_HOLDER_CLASS, USE_BIG_DATA_IO_FOR_MESSAGES, USE_INPUT_SPLIT_LOCALITY, USE_MESSAGE_SIZE_ENCODING, USE_OUT_OF_CORE_GRAPH, USE_PRIMITIVE_MESSAGE_STORE, USE_SUPERSTEP_COUNTERS, USE_UNSAFE_SERIALIZATION, USER_PARTITION_COUNT, VERTEX_CLASS, VERTEX_EDGES_CLASS, VERTEX_EDGES_FACTORY_CLASS, VERTEX_ID_CLASS, VERTEX_ID_FACTORY_CLASS, VERTEX_INPUT_FILTER_CLASS, VERTEX_INPUT_FORMAT_CLASS, VERTEX_OUTPUT_FORMAT_CLASS, VERTEX_OUTPUT_FORMAT_SUBDIR, VERTEX_OUTPUT_FORMAT_THREAD_SAFE, VERTEX_OUTPUT_PATH, VERTEX_RESOLVER_CLASS, VERTEX_VALUE_CLASS, VERTEX_VALUE_COMBINER_CLASS, VERTEX_VALUE_FACTORY_CLASS, VERTICES_TO_UPDATE_PROGRESS, WAIT_FOR_OTHER_WORKERS_TIMEOUT_MSEC, WAIT_TASK_DONE_TIMEOUT_MS, WAIT_TIME_BETWEEN_CONNECTION_RETRIES_MS, WAIT_ZOOKEEPER_TIMEOUT_MSEC, WAITING_REQUEST_MSECS, WORKER_CONTEXT_CLASS, WORKER_OBSERVER_CLASSES, YOURKIT_OUTPUT_DIR, YOURKIT_OUTPUT_DIR_DEFAULT, ZOOKEEPER_BASE_PATH_COUNTER_GROUP, ZOOKEEPER_CONNECTION_ATTEMPTS, ZOOKEEPER_DIR, ZOOKEEPER_FORCE_SYNC, ZOOKEEPER_HALT_NODE_COUNTER_GROUP, ZOOKEEPER_IS_EXTERNAL, ZOOKEEPER_LIST, ZOOKEEPER_MANAGER_DIRECTORY, ZOOKEEPER_MAX_SESSION_TIMEOUT, ZOOKEEPER_MIN_SESSION_TIMEOUT, ZOOKEEPER_OPS_MAX_ATTEMPTS, ZOOKEEPER_OPS_RETRY_WAIT_MSECS, ZOOKEEPER_PURGE_INTERVAL, ZOOKEEPER_SERVER_PORT, ZOOKEEPER_SERVER_PORT_COUNTER_GROUP, ZOOKEEPER_SERVERLIST_POLL_MSECS, ZOOKEEPER_SESSION_TIMEOUT, ZOOKEEPER_SKIP_ACL, ZOOKEEPER_SNAP_RETAIN_COUNT

Constructor Summary

Constructors

Constructor	Description
ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration)	Non- simplefragment parameterized constructor use for VertexInputForm.
ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration, IFragment fragment)
ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration, String cppFragStr, int fid, int fnum)

Method Summary

Modifier and Type	Method	Description
void	configureIfPossible(Object obj)	Configure an object with this instance if the object is configurable.
E	createEdgeValue()
org.apache.giraph.utils.ExtendedDataInput	createExtendedDataInput(byte[] buf)	Create an extended data input (can be subclassed)
org.apache.giraph.utils.ExtendedDataInput	createExtendedDataInput(byte[] buf, int off, int length)	Create an extended data input (can be subclassed)
org.apache.giraph.utils.ExtendedDataInput	createExtendedDataInput(org.apache.giraph.utils.ExtendedDataOutput extendedDataOutput)	Create extendedDataInput based on extendedDataOutput
org.apache.giraph.utils.ExtendedDataOutput	createExtendedDataOutput()	Create an extended data output (can be subclassed)
org.apache.giraph.utils.ExtendedDataOutput	createExtendedDataOutput(byte[] buf, int pos)	Create an extended data output (can be subclassed)
org.apache.giraph.utils.ExtendedDataOutput	createExtendedDataOutput(int expectedSize)	Create an extended data output (can be subclassed)
org.apache.hadoop.io.Writable	createInComingMessageValue()
<M extends org.apache.hadoop.io.Writable> org.apache.giraph.factories.MessageValueFactory<M>	createIncomingMessageValueFactory()	Create new incoming message value factory
MasterCompute	createMasterCompute()	Create a user master
<M extends org.apache.hadoop.io.Writable> org.apache.giraph.combiner.MessageCombiner<? super I,M>	createOutgoingMessageCombiner()	Create a user combiner class
org.apache.hadoop.io.Writable	createOutgoingMessageValue()
<M extends org.apache.hadoop.io.Writable> org.apache.giraph.factories.MessageValueFactory<M>	createOutgoingMessageValueFactory()	Create new outgoing message value factory
org.apache.giraph.graph.Vertex<I,V,E>	createVertex()	Create a vertex
I	createVertexId()
V	createVertexValue()
WorkerContext	createWorkerContext()	Create a user worker context
org.apache.giraph.io.internal.WrappedVertexOutputFormat<I,V,E>	createWrappedVertexOutputFormat()	Create a wrapper for user vertex output format, which makes sure that Configuration parameters are set properly in all methods related to this format.
Class<? extends org.apache.giraph.graph.Computation<I,V,E,? extends org.apache.hadoop.io.Writable,? extends org.apache.hadoop.io.Writable>>	getComputationClass()	Get the user's subclassed Computation
String	getDefaultWorkerFile()	Generate the string for default work file to write data to.
Class<? extends org.apache.giraph.io.EdgeInputFormat<I,E>>	getEdgeInputFormatClass()	Get the user's subclassed EdgeInputFormat.
Class<E>	getEdgeValueClass()
Class<?>	getGrapeEdataClass()
Class<?>	getGrapeOidClass()
Class<?>	getGrapeVdataClass()
Class<?>	getGrapeVidClass()
<M extends org.apache.hadoop.io.Writable> org.apache.giraph.conf.MessageClasses<I,M>	getIncomingMessageClasses()	Get incoming message classes
<M extends org.apache.hadoop.io.Writable> Class<M>	getIncomingMessageValueClass()	Get the user's subclassed incoming message value class.
int	getInetAddressMaxResolveTime()
Class<? extends MasterCompute>	getMasterComputeClass()	Get the user's subclassed MasterCompute
<M extends org.apache.hadoop.io.Writable> org.apache.giraph.conf.MessageClasses<I,M>	getOutgoingMessageClasses()	Get outgoing message classes
<M extends org.apache.hadoop.io.Writable> Class<M>	getOutgoingMessageValueClass()	Get the user's subclassed outgoing message value class.
String	getOutMessageCacheType()
boolean	getUseUnsafeSerialization()	Whether to use an unsafe serialization
Class<I>	getVertexIdClass()	Get the user's subclassed vertex index class.
Class<? extends org.apache.giraph.io.VertexOutputFormat<I,V,E>>	getVertexOutputFormatClass()	Get the user's subclassed VertexOutputFormat.
Class<V>	getVertexValueClass()
Class<? extends WorkerContext>	getWorkerContextClass()	Get the user's subclassed WorkerContext.
int	getWorkerId()
int	getWorkerNum()
boolean	hasVertexOutputFormat()	Does the job have a VertexOutputFormat?
void	setMessageCombinerClass(Class<? extends org.apache.giraph.combiner.MessageCombiner> messageCombinerClass)	Set the message combiner class (optional)
void	updateSuperstepClasses(org.apache.giraph.master.SuperstepClasses superstepClasses)	Update Computation and MessageCombiner class used
boolean	useOutgoingMessageCombiner()	Check if user set a combiner

Methods inherited from class org.apache.giraph.conf.GiraphConfiguration

getAggregatorServerInitPort, getEdgeManager, getLocalHostOrIp, getMessagerInitServerPort, getNettyAllocator, getNettyServerExecutionThreads, getVertexInputFormatClass, hasVertexOutputFormatSubdir, setComputationClass, setEdgeInputFormatClass, setEdgeManager, setMasterComputeClass, setUsePrimitiveMessageStore, setVertexInputFormatClass, setVertexOutputFormatClass, setVertexOutputFormatSubdir, setVertexOutputPath, setWorkerContextClass, usePrimitiveMessageStore

Methods inherited from class org.apache.hadoop.conf.Configuration

addDefaultResource, addDeprecation, addDeprecation, addDeprecation, addDeprecation, addDeprecations, addResource, addResource, addResource, addResource, addResource, addResource, addResource, addResource, addResource, addResource, addResource, addTags, clear, dumpConfiguration, dumpConfiguration, dumpDeprecatedKeys, get, get, getAllPropertiesByTag, getAllPropertiesByTags, getBoolean, getClass, getClass, getClassByName, getClassByNameOrNull, getClasses, getClassLoader, getConfResourceAsInputStream, getConfResourceAsReader, getDouble, getEnum, getFile, getFinalParameters, getFloat, getInstances, getInt, getInts, getLocalPath, getLong, getLongBytes, getPassword, getPasswordFromConfig, getPasswordFromCredentialProviders, getPattern, getPropertySources, getProps, getPropsWithPrefix, getRange, getRaw, getResource, getSocketAddr, getSocketAddr, getStorageSize, getStorageSize, getStringCollection, getStrings, getStrings, getTimeDuration, getTimeDuration, getTimeDurationHelper, getTimeDurations, getTrimmed, getTrimmed, getTrimmedStringCollection, getTrimmedStrings, getTrimmedStrings, getValByRegex, hasWarnedDeprecation, isDeprecated, isPropertyTag, iterator, main, onlyKeyExists, readFields, reloadConfiguration, reloadExistingConfigurations, set, set, setAllowNullValueProperties, setBoolean, setBooleanIfUnset, setClass, setClassLoader, setDeprecatedProperties, setDouble, setEnum, setFloat, setIfUnset, setInt, setLong, setPattern, setQuietMode, setRestrictSystemProperties, setRestrictSystemPropertiesDefault, setRestrictSystemProps, setSocketAddr, setStorageSize, setStrings, setTimeDuration, size, toString, unset, updateConnectAddr, updateConnectAddr, write, writeXml, writeXml, writeXml

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Constructor Detail

ImmutableClassesGiraphConfiguration

public ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration)

Non- simplefragment parameterized constructor use for VertexInputForm.

Parameters:

configuration - configuration.

ImmutableClassesGiraphConfiguration

public ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration,
                                           IFragment fragment)

ImmutableClassesGiraphConfiguration

public ImmutableClassesGiraphConfiguration(org.apache.hadoop.conf.Configuration configuration,
                                           String cppFragStr,
                                           int fid,
                                           int fnum)

Method Detail

configureIfPossible

public void configureIfPossible(Object obj)

Configure an object with this instance if the object is configurable.

Parameters:

obj - Object

createVertex

public org.apache.giraph.graph.Vertex<I,V,E> createVertex()

Create a vertex

Returns:

Instantiated vertex

hasVertexOutputFormat

public boolean hasVertexOutputFormat()

Description copied from class: GiraphConfiguration

Does the job have a VertexOutputFormat?

Overrides:

hasVertexOutputFormat in class GiraphConfiguration

Returns:

True iff a VertexOutputFormat has been specified.

createWrappedVertexOutputFormat

public org.apache.giraph.io.internal.WrappedVertexOutputFormat<I,V,E> createWrappedVertexOutputFormat()

Create a wrapper for user vertex output format, which makes sure that Configuration parameters are set properly in all methods related to this format.

Returns:

Wrapper around user vertex output format

getVertexOutputFormatClass

public Class<? extends org.apache.giraph.io.VertexOutputFormat<I,V,E>> getVertexOutputFormatClass()

Get the user's subclassed VertexOutputFormat.

Returns:

User's vertex output format class

getEdgeInputFormatClass

public Class<? extends org.apache.giraph.io.EdgeInputFormat<I,E>> getEdgeInputFormatClass()

Get the user's subclassed EdgeInputFormat.

Returns:

User's edge input format class

getDefaultWorkerFile

public String getDefaultWorkerFile()

Generate the string for default work file to write data to. shall be unique for each run.

getWorkerContextClass

public Class<? extends WorkerContext> getWorkerContextClass()

Get the user's subclassed WorkerContext.

Overrides:

getWorkerContextClass in class GiraphConfiguration

Returns:

User's worker context class

createWorkerContext

public WorkerContext createWorkerContext()

Create a user worker context

Returns:

Instantiated user worker context

getComputationClass

public Class<? extends org.apache.giraph.graph.Computation<I,V,E,? extends org.apache.hadoop.io.Writable,? extends org.apache.hadoop.io.Writable>> getComputationClass()

Description copied from class: GiraphConfiguration

Get the user's subclassed Computation

Overrides:

getComputationClass in class GiraphConfiguration

Returns:

User's computation class

getVertexIdClass

public Class<I> getVertexIdClass()

Get the user's subclassed vertex index class.

Returns:

User's vertex index class

createVertexId

public I createVertexId()

getVertexValueClass

public Class<V> getVertexValueClass()

createVertexValue

public V createVertexValue()

getEdgeValueClass

public Class<E> getEdgeValueClass()

createEdgeValue

public E createEdgeValue()

createInComingMessageValue

public org.apache.hadoop.io.Writable createInComingMessageValue()

createOutgoingMessageValue

public org.apache.hadoop.io.Writable createOutgoingMessageValue()

getGrapeOidClass

public Class<?> getGrapeOidClass()

getGrapeVidClass

public Class<?> getGrapeVidClass()

getGrapeVdataClass

public Class<?> getGrapeVdataClass()

getGrapeEdataClass

public Class<?> getGrapeEdataClass()

getIncomingMessageValueClass

public <M extends org.apache.hadoop.io.Writable> Class<M> getIncomingMessageValueClass()

Get the user's subclassed incoming message value class.

Type Parameters:

M - Message data

Returns:

User's vertex message value class

getOutgoingMessageValueClass

public <M extends org.apache.hadoop.io.Writable> Class<M> getOutgoingMessageValueClass()

Get the user's subclassed outgoing message value class.

Type Parameters:

M - Message type

Returns:

User's vertex message value class

getIncomingMessageClasses

public <M extends org.apache.hadoop.io.Writable> org.apache.giraph.conf.MessageClasses<I,M> getIncomingMessageClasses()

Get incoming message classes

Type Parameters:

M - message type

Returns:

incoming message classes

getOutgoingMessageClasses

public <M extends org.apache.hadoop.io.Writable> org.apache.giraph.conf.MessageClasses<I,M> getOutgoingMessageClasses()

Get outgoing message classes

Type Parameters:

M - message type

Returns:

outgoing message classes

createOutgoingMessageValueFactory

public <M extends org.apache.hadoop.io.Writable> org.apache.giraph.factories.MessageValueFactory<M> createOutgoingMessageValueFactory()

Create new outgoing message value factory

Type Parameters:

M - message type

Returns:

outgoing message value factory

createIncomingMessageValueFactory

public <M extends org.apache.hadoop.io.Writable> org.apache.giraph.factories.MessageValueFactory<M> createIncomingMessageValueFactory()

Create new incoming message value factory

Type Parameters:

M - message type

Returns:

incoming message value factory

setMessageCombinerClass

public void setMessageCombinerClass(Class<? extends org.apache.giraph.combiner.MessageCombiner> messageCombinerClass)

Description copied from class: GiraphConfiguration

Set the message combiner class (optional)

Overrides:

setMessageCombinerClass in class GiraphConfiguration

Parameters:

messageCombinerClass - Determines how vertex messages are combined

createOutgoingMessageCombiner

public <M extends org.apache.hadoop.io.Writable> org.apache.giraph.combiner.MessageCombiner<? super I,M> createOutgoingMessageCombiner()

Create a user combiner class

Type Parameters:

M - Message data

Returns:

Instantiated user combiner class

useOutgoingMessageCombiner

public boolean useOutgoingMessageCombiner()

Check if user set a combiner

Returns:

True iff user set a combiner class

updateSuperstepClasses

public void updateSuperstepClasses(org.apache.giraph.master.SuperstepClasses superstepClasses)

Update Computation and MessageCombiner class used

Parameters:

superstepClasses - SuperstepClasses

getMasterComputeClass

public Class<? extends MasterCompute> getMasterComputeClass()

Get the user's subclassed MasterCompute

Returns:

User's master class

createMasterCompute

public MasterCompute createMasterCompute()

Create a user master

Returns:

Instantiated user master

getWorkerId

public int getWorkerId()

getWorkerNum

public int getWorkerNum()

getInetAddressMaxResolveTime

public int getInetAddressMaxResolveTime()

getUseUnsafeSerialization

public boolean getUseUnsafeSerialization()

Whether to use an unsafe serialization

Returns:

whether to use unsafe serialization

createExtendedDataOutput

public org.apache.giraph.utils.ExtendedDataOutput createExtendedDataOutput()

Create an extended data output (can be subclassed)

Returns:

ExtendedDataOutput object

createExtendedDataOutput

public org.apache.giraph.utils.ExtendedDataOutput createExtendedDataOutput(int expectedSize)

Create an extended data output (can be subclassed)

Parameters:

expectedSize - Expected size

Returns:

ExtendedDataOutput object

createExtendedDataOutput

public org.apache.giraph.utils.ExtendedDataOutput createExtendedDataOutput(byte[] buf,
                                                                           int pos)

Create an extended data output (can be subclassed)

Parameters:

buf - Buffer to use for the output (reuse perhaps)

pos - How much of the buffer is already used

Returns:

ExtendedDataOutput object

createExtendedDataInput

public org.apache.giraph.utils.ExtendedDataInput createExtendedDataInput(byte[] buf,
                                                                         int off,
                                                                         int length)

Create an extended data input (can be subclassed)

Parameters:

buf - Buffer to use for the input

off - Where to start reading in the buffer

length - Maximum length of the buffer

Returns:

ExtendedDataInput object

createExtendedDataInput

public org.apache.giraph.utils.ExtendedDataInput createExtendedDataInput(byte[] buf)

Create an extended data input (can be subclassed)

Parameters:

buf - Buffer to use for the input

Returns:

ExtendedDataInput object

createExtendedDataInput

public org.apache.giraph.utils.ExtendedDataInput createExtendedDataInput(org.apache.giraph.utils.ExtendedDataOutput extendedDataOutput)

Create extendedDataInput based on extendedDataOutput

Parameters:

extendedDataOutput - extendedDataOutput

Returns:

extendedDataInput

getOutMessageCacheType

public String getOutMessageCacheType()