Search Java Classes and Packages
#Spark Classes and Interfaces - 163 results found.
| Name | Description | Type | Package | Framework |
| DefaultSparkStreamingModuleOptionsMetadata | Default module options for SparkStreamingSupport. | Class | org.springframework.xd.spark.streaming | Spring XD |
| SparkAppJob | Class | org.springframework.xd.test.fixtures | Spring XD | |
| SparkAppOptionsMetadata | Module options for Spark application module. | Class | org.springframework.xd.spark | Spring XD |
| SparkMessageSender | Abstract class that defines abstract methods to support sending the computed messages out of Spark clusterto XD MessageBus etc. | Class | org.springframework.xd.spark.streaming | Spring XD |
| SparkPi | SparkPi Sample Code that utilizes spark master calls to generate a rough estimate of pi. | Class | spark | Spring XD |
| SparkStreamingChannel | The DirectChannel that provides support forspark streaming configurations. | Class | org.springframework.xd.dirt.plugins.spark.streaming | Spring XD |
| SparkStreamingContainerFilter | A ContainerFilter which filters out the containers that have a sparkstreaming module running. | Class | org.springframework.xd.dirt.spark | Spring XD |
| SparkStreamingModuleExecutor | The interface that streaming module executor will implement that runs the computation logic on the input DStreamand send the output via $SparkMessageSender. | Interface | org.springframework.xd.spark.streaming | Spring XD |
| SparkStreamingPlugin | Plugin for Spark Streaming support. | Class | org.springframework.xd.dirt.plugins.spark.streaming | Spring XD |
| SparkStreamingSupport | Base interface for spring XD and spark streaming integration. | Interface | org.springframework.xd.spark.streaming | Spring XD |
| SparkTasklet | Tasklet for running Spark application. | Class | org.springframework.xd.spark.tasklet | Spring XD |
| CalcitePrepare .SparkHandler | Callback to register Spark as the main engine. | Interface | org.apache.calcite.jdbc.CalcitePrepare | Calcite |
| CalcitePrepare .SparkHandler .RuleSetBuilder | Allows Spark to declare the rules it needs. | Interface | org.apache.calcite.jdbc.CalcitePrepare.SparkHandler | Calcite |
| EnumerableToSparkConverter | Relational expression that converts input of EnumerableConvention into Spark convention. | Class | org.apache.calcite.adapter.spark | Calcite |
| EnumerableToSparkConverterRule | Class | org.apache.calcite.adapter.spark | Calcite | |
| JdbcToSparkConverter | Relational expression representing a scan of a table in a JDBC data source that returns its results as a Spark RDD. | Class | org.apache.calcite.adapter.spark | Calcite |
| JdbcToSparkConverterRule | Class | org.apache.calcite.adapter.spark | Calcite | |
| SparkHandlerImpl | CalcitePrepare. | Class | org.apache.calcite.adapter.spark | Calcite |
| SparkMethod | Built-in methods in the Spark adapter. | Class | org.apache.calcite.adapter.spark | Calcite |
| SparkRel | Relational expression that uses Spark calling convention. | Interface | org.apache.calcite.adapter.spark | Calcite |
| SparkRel .Implementor | Class | org.apache.calcite.adapter.spark.SparkRel | Calcite | |
| SparkRel .Result | Class | org.apache.calcite.adapter.spark.SparkRel | Calcite | |
| SparkRules | Rules for the Spark calling convention. | Class | org.apache.calcite.adapter.spark | Calcite |
| SparkRules .SparkCalc | in Spark convention. | Class | org.apache.calcite.adapter.spark.SparkRules | Calcite |
| SparkRules .SparkValues | VALUES construct implemented in Spark. | Class | org.apache.calcite.adapter.spark.SparkRules | Calcite |
| SparkRules .SparkValuesRule | Planner rule that implements VALUES operator in Spark convention. | Class | org.apache.calcite.adapter.spark.SparkRules | Calcite |
| SparkRuntime | Runtime utilities for Calcite's Spark adapter. | Class | org.apache.calcite.adapter.spark | Calcite |
| SparkRuntime .CalciteFlatMapFunction | Combines linq4j Function and Spark FlatMapFunction. | Class | org.apache.calcite.adapter.spark.SparkRuntime | Calcite |
| SparkToEnumerableConverter | Relational expression that converts input of into EnumerableConvention. | Class | org.apache.calcite.adapter.spark | Calcite |
| JavaSparkContext | A Java-friendly version of SparkContext that returns JavaRDDs and works with Java collections instead of Scala ones. | Class | org.apache.spark.api.java | Apache Spark |
| JavaSparkListener | Java clients should extend this class instead of implementing SparkListener directly. | Class | org.apache.spark | Apache Spark |
| JavaSparkStatusTracker | Low-level status reporting APIs for monitoring job and stage progress. | Class | org.apache.spark.api.java | Apache Spark |
| SparkAppHandle | A handle to a running Spark application. | Interface | org.apache.spark.launcher | Apache Spark |
| SparkAppHandle .Listener | Listener for updates to a handle's state. | Interface | org.apache.spark.launcher.SparkAppHandle | Apache Spark |
| SparkAppHandle .State | Represents the application's state. | Class | org.apache.spark.launcher.SparkAppHandle | Apache Spark |
| SparkConf | Configuration for a Spark application. | Class | org.apache.spark | Apache Spark |
| SparkContext | Main entry point for Spark functionality. | Class | org.apache.spark | Apache Spark |
| SparkContext .DoubleAccumulatorParam$ | Class | org.apache.spark.SparkContext | Apache Spark | |
| SparkContext .FloatAccumulatorParam$ | Class | org.apache.spark.SparkContext | Apache Spark | |
| SparkContext .IntAccumulatorParam$ | Class | org.apache.spark.SparkContext | Apache Spark | |
| SparkContext .LongAccumulatorParam$ | Class | org.apache.spark.SparkContext | Apache Spark | |
| SparkEnv | Holds all the runtime environment objects for a running Spark instance (either master or worker), including the serializer, Akka actor system, block manager, map output tracker, etc. | Class | org.apache.spark | Apache Spark |
| SparkException | Class | org.apache.spark | Apache Spark | |
| SparkFiles | Resolves paths to files added through SparkContext. | Class | org.apache.spark | Apache Spark |
| SparkFirehoseListener | Class that allows users to receive all SparkListener events. | Class | org.apache.spark | Apache Spark |
| SparkFlumeEvent | A wrapper class for AvroFlumeEvent's with a custom serialization format. | Class | org.apache.spark.streaming.flume | Apache Spark |
| SparkJobInfo | Exposes information about Spark Jobs. | Interface | org.apache.spark | Apache Spark |
| SparkJobInfoImpl | Class | org.apache.spark | Apache Spark | |
| SparkLauncher | Launcher for Spark applications. | Class | org.apache.spark.launcher | Apache Spark |
| SparkListener | Interface for listening to events from the Spark scheduler. | Interface | org.apache.spark.scheduler | Apache Spark |
| SparkListenerApplicationEnd | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerApplicationStart | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerBlockManagerAdded | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerBlockManagerRemoved | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerBlockUpdated | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerEnvironmentUpdate | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerExecutorAdded | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerExecutorMetricsUpdate | Periodic updates from executors. | Class | org.apache.spark.scheduler | Apache Spark |
| SparkListenerExecutorRemoved | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerJobEnd | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerJobStart | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerStageCompleted | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerStageSubmitted | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerTaskEnd | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerTaskGettingResult | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerTaskStart | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkListenerUnpersistRDD | Class | org.apache.spark.scheduler | Apache Spark | |
| SparkMasterRegex | A collection of regexes for extracting information from the master string. | Class | org.apache.spark | Apache Spark |
| SparkShutdownHook | Class | org.apache.spark.util | Apache Spark | |
| SparkStageInfo | Exposes information about Spark Stages. | Interface | org.apache.spark | Apache Spark |
| SparkStageInfoImpl | Class | org.apache.spark | Apache Spark | |
| SparkStatusTracker | Low-level status reporting APIs for monitoring job and stage progress. | Class | org.apache.spark | Apache Spark |
| SparkCollectFactory | Constructor SummarySparkCollectFactory() | Class | org.apache.crunch.impl.spark.collect | Apache Crunch |
| SparkCollection | Interface | org.apache.crunch.impl.spark | Apache Crunch | |
| SparkComparator | Class | org.apache.crunch.impl.spark | Apache Crunch | |
| SparkCounter | Class | org.apache.hadoop.mapred | Apache Crunch | |
| SparkPartitioner | Class | org.apache.crunch.impl.spark | Apache Crunch | |
| SparkPipeline | Constructor SummarySparkPipeline(org. | Class | org.apache.crunch.impl.spark | Apache Crunch |
| SparkRuntime | Nested Class SummaryNested classes/interfaces inherited from interface org. | Class | org.apache.crunch.impl.spark | Apache Crunch |
| SparkRuntimeContext | Class | org.apache.crunch.impl.spark | Apache Crunch | |
| CounterStatsAggregatorSpark | Class | org.apache.hadoop.hive.ql.stats | Apache Hive | |
| GenSparkProcContext | GenSparkProcContext maintains information about the tasks and operators as we walk the operator tree to break them into SparkTasks. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| GenSparkSkewJoinProcessor | Copied from GenMRSkewJoinProcessor. | Class | org.apache.hadoop.hive.ql.optimizer.physical | Apache Hive |
| GenSparkUtils | GenSparkUtils is a collection of shared helper methods to produce SparkWork Cloned from GenTezUtils. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| GenSparkWork | GenSparkWork separates the operator tree into spark tasks. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| GenSparkWorkWalker | Walks the operator tree in DFS fashion. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| HiveSparkClient | Interface | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| HiveSparkClientFactory | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| LocalHiveSparkClient | LocalSparkClient submit Spark job in local driver, it's responsible for build spark client environment and execute spark work. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| LocalSparkJobMonitor | LocalSparkJobMonitor monitor a single Spark job status in a loop until job finished/failed/killed. | Class | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive |
| LocalSparkJobRef | Class | org.apache.hadoop.hive.ql.exec.spark.status.impl | Apache Hive | |
| LocalSparkJobStatus | Class | org.apache.hadoop.hive.ql.exec.spark.status.impl | Apache Hive | |
| MiniSparkOnYARNCluster | Class | org.apache.hadoop.hive.shims | Apache Hive | |
| OptimizeSparkProcContext | OptimizeSparkProcContext. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| RemoteHiveSparkClient | RemoteSparkClient is a wrapper of SparkClient, which wrap a spark job request and send to an remote SparkContext. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| RemoteSparkJobMonitor | RemoteSparkJobMonitor monitor a RSC remote job status in a loop until job finished/failed/killed. | Class | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive |
| RemoteSparkJobRef | Class | org.apache.hadoop.hive.ql.exec.spark.status.impl | Apache Hive | |
| RemoteSparkJobStatus | Used with remove spark client. | Class | org.apache.hadoop.hive.ql.exec.spark.status.impl | Apache Hive |
| SetSparkReducerParallelism | SetSparkReducerParallelism determines how many reducers should be run for a given reduce sink, clone from SetReducerParallelism. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkBucketMapJoinContext | Class | org.apache.hadoop.hive.ql.plan | Apache Hive | |
| SparkClient | Defines the API for the Spark remote client. | Interface | org.apache.hive.spark.client | Apache Hive |
| SparkClientFactory | Factory for SparkClient instances. | Class | org.apache.hive.spark.client | Apache Hive |
| SparkClientUtilities | Class | org.apache.hive.spark.client | Apache Hive | |
| SparkCompiler | SparkCompiler translates the operator plan into SparkTasks. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| SparkCounter | Class | org.apache.hive.spark.counter | Apache Hive | |
| SparkCounterGroup | We use group to fold all the same kind of counters. | Class | org.apache.hive.spark.counter | Apache Hive |
| SparkCounters | SparkCounters is used to collect Hive operator metric through Spark accumulator. | Class | org.apache.hive.spark.counter | Apache Hive |
| SparkCrossProductCheck | Check each MapJoin and ShuffleJoin Operator to see if they are performing a cross product. | Class | org.apache.hadoop.hive.ql.optimizer.physical | Apache Hive |
| SparkEdgeProperty | Class | org.apache.hadoop.hive.ql.plan | Apache Hive | |
| SparkFileSinkProcessor | FileSinkProcessor handles addition of merge, move and stats tasks for filesinks. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| SparkHashTableSinkDesc | Map Join operator Descriptor implementation. | Class | org.apache.hadoop.hive.ql.plan | Apache Hive |
| SparkHashTableSinkOperator | Class | org.apache.hadoop.hive.ql.exec | Apache Hive | |
| SparkJobRef | Interface | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive | |
| SparkJobState | Class | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive | |
| SparkJobStatus | SparkJobStatus identify what Hive want to know about the status of a Spark job. | Interface | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive |
| SparkJoinHintOptimizer | This processes joins in which user specified a hint to identify the small-table. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkJoinOptimizer | Converts a join to a more optimized join for the Spark path. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkMapJoinOptimizer | SparkMapJoinOptimizer cloned from ConvertJoinMapJoin is an optimization that replaces a common join (aka shuffle join) with a map join (aka broadcast or fragment replicate | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkMapJoinProcessor | Class | org.apache.hadoop.hive.ql.optimizer | Apache Hive | |
| SparkMapJoinResolver | Class | org.apache.hadoop.hive.ql.optimizer.physical | Apache Hive | |
| SparkMapRecordHandler | Clone from ExecMapper. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| SparkMergeFileRecordHandler | Copied from MergeFileMapper. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| SparkPlan | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkPlanGenerator | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkProcessAnalyzeTable | ProcessAnalyzeTable sets up work for the several variants of analyze table (normal, no scan, partial scan. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| SparkRecordHandler | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkReduceRecordHandler | Clone from ExecReducer, it is the bridge between the spark framework and the Hive operator pipeline at execution time. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| SparkReduceSinkMapJoinProc | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive | |
| SparkReduceSinkMapJoinProc .SparkMapJoinFollowedByGroupByProcessor | Class | org.apache.hadoop.hive.ql.optimizer.spark.SparkReduceSinkMapJoinProc | Apache Hive | |
| SparkReporter | UnsupportedOperationException for other unrelated methods, so if any Hive feature depends on these unimplemented methods, we could go back here quickly and enable it. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| SparkSession | Interface | org.apache.hadoop.hive.ql.exec.spark.session | Apache Hive | |
| SparkSessionImpl | Class | org.apache.hadoop.hive.ql.exec.spark.session | Apache Hive | |
| SparkSessionManager | Defines interface for managing multiple SparkSessions in Hive when multiple users are executing queries simultaneously on Spark execution engine. | Interface | org.apache.hadoop.hive.ql.exec.spark.session | Apache Hive |
| SparkSessionManagerImpl | Simple implementation of SparkSessionManager - returns SparkSession when requested through getSession and keeps track of | Class | org.apache.hadoop.hive.ql.exec.spark.session | Apache Hive |
| SparkShuffler | Interface | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkSkewJoinProcFactory | Spark-version of SkewJoinProcFactory. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkSkewJoinProcFactory .SparkSkewJoinJoinProcessor | Class | org.apache.hadoop.hive.ql.optimizer.spark.SparkSkewJoinProcFactory | Apache Hive | |
| SparkSkewJoinResolver | Spark version of SkewJoinResolver. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkSkewJoinResolver .SparkSkewJoinProcCtx | Class | org.apache.hadoop.hive.ql.optimizer.spark.SparkSkewJoinResolver | Apache Hive | |
| SparkSMBJoinHintOptimizer | Converts from a bucket-mapjoin created from hints to SMB mapjoin. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkSMBMapJoinInfo | Data structure to keep track of SMBMapJoin operators during query compilation for Spark. | Class | org.apache.hadoop.hive.ql.parse.spark | Apache Hive |
| SparkSortMergeJoinFactory | Operator factory for Spark SMBJoin processing. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkSortMergeJoinOptimizer | Converts a common join operator to an SMB join if eligible. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| SparkStageProgress | Class | org.apache.hadoop.hive.ql.exec.spark.status | Apache Hive | |
| SparkStatistic | Class | org.apache.hadoop.hive.ql.exec.spark.Statistic | Apache Hive | |
| SparkStatisticGroup | Class | org.apache.hadoop.hive.ql.exec.spark.Statistic | Apache Hive | |
| SparkStatistics | Class | org.apache.hadoop.hive.ql.exec.spark.Statistic | Apache Hive | |
| SparkStatisticsBuilder | Class | org.apache.hadoop.hive.ql.exec.spark.Statistic | Apache Hive | |
| SparkTask | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkTran | Interface | org.apache.hadoop.hive.ql.exec.spark | Apache Hive | |
| SparkUtilities | Contains utilities methods used as part of Spark tasks. | Class | org.apache.hadoop.hive.ql.exec.spark | Apache Hive |
| SparkWork | This class encapsulates all the work objects that can be executed in a single Spark job. | Class | org.apache.hadoop.hive.ql.plan | Apache Hive |
| SplitSparkWorkResolver | Do a BFS on the sparkWork graph, and look for any work that has more than one child. | Class | org.apache.hadoop.hive.ql.optimizer.spark | Apache Hive |
| Spark | Class | spark | Spark Micro Web | |
| SparkApplication | Interface | spark.servlet | Spark Micro Web | |
| SparkFilter | Class | spark.servlet | Spark Micro Web | |
| SparkServer | java. | Interface | spark.webserver | Spark Micro Web |
| SparkServerFactory | Class | spark.webserver | Spark Micro Web | |
| SparkServerImpl | Class | spark.webserver | Spark Micro Web | |
| SparkUtils | Class | spark.utils | Spark Micro Web | |
| SparklinesTransform | Nested Class SummaryNested classes/interfaces inherited from class com. | Class | com.microstrategy.sdk.samples.transforms | MicroStrategy |
| SparkleFilter | See Also:Serialized FormFields inherited from class java. | Class | org.jscience.media.pictures.filters | JScience |
| Spark | Class | edu.wpi.first.wpilibj | Roborio | |