ThriftPucket

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. def absorb(pucket: Pucket[T]): \/[Throwable, Unit]

   

   Absorb another pucket of the same type into this one

   Absorb another pucket of the same type into this one

   Will only absorb if the pucket it is absorbing is on a different path and the descriptor is the same

   pucket

   the pucket to be absorbed

   Definition Classes

   Pucket

5. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

6. val blockSize: Int

   

   Default Parquet block size

   Default Parquet block size

   Definition Classes

   ThriftPucket → Pucket

7. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. val conf: Configuration

   

   Hadoop configuration

   Hadoop configuration

   Definition Classes

   Pucket

9. val descriptor: ThriftPucketDescriptor[T]

   

   the pucket descriptor.

   the pucket descriptor. See com.intenthq.pucket.thrift.ThriftPucketDescriptor

   Definition Classes

   ThriftPucket → Pucket

10. final def eq(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

11. def file: Path

    

    Generate a filename

    Generate a filename

    returns

    a relative hadoop path to a new randomly generated filename

    Definition Classes

    Pucket

12. def filename: Path

    

    Generate a fully qualified filename under the pucket

    Generate a fully qualified filename under the pucket

    returns

    a fully qualified hadoop path to a new randomly generated filename under pucket

    Definition Classes

    Pucket

13. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

14. val fs: FileSystem

    

    hadoop filesystem instance

    hadoop filesystem instance

    Definition Classes

    ThriftPucket → Pucket

15. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

16. val id: Int

    

    An identifier for the pucket for use in writer cache

    An identifier for the pucket for use in writer cache

    returns

    a string identifier

    Definition Classes

    Pucket

17. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

18. def listFiles: \/[Throwable, Seq[Path]]

    

    List all the parquet files in the pucket

    List all the parquet files in the pucket

    returns

    a list of fully qualified paths to parquet files

    Definition Classes

    Pucket

19. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

20. def newInstance(newPath: Path): Pucket[T]

    

    Used when obtaining a new pucket as a subdir of an existing one

    Used when obtaining a new pucket as a subdir of an existing one

    Attributes

    protected

    Definition Classes

    ThriftPucket → Pucket

21. final def notify(): Unit

    

    Definition Classes

    AnyRef

22. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

23. def partition(data: T): Path

    

    Use the partitioner specified in the descriptor to get a new pucket on a calculated path

    Use the partitioner specified in the descriptor to get a new pucket on a calculated path

    data

    the object to inspect for partitioning

    returns

    a new path which is a subpath under the pucket, otherwise the current path

    Definition Classes

    Pucket

24. val path: Path

    

    path to the pucket

    path to the pucket

    Definition Classes

    ThriftPucket → Pucket

25. def reader(filter: Option[Filter]): \/[Throwable, Reader[T]]

    

    Reader for the pucket.

    Reader for the pucket. See com.intenthq.pucket.reader.Reader

    returns

    a new Reader for reading data from the pucket

    Definition Classes

    ThriftPucket → Pucket

26. def reader: \/[Throwable, Reader[T]]

    

    Reader for the pucket.

    Reader for the pucket. See com.intenthq.pucket.reader.Reader

    Definition Classes

    Pucket

27. def subPucket(subPath: Path): \/[Throwable, Pucket[T]]

    

    Create a directory as a subpath of the pucket and create a new pucket instance at the new path

    Create a directory as a subpath of the pucket and create a new pucket instance at the new path

    returns

    a new pucket at the sub path specified or an error if the path creation fails

    Definition Classes

    Pucket

28. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

29. def targetFile(pucket: Pucket[T], otherPath: Path): Path

    

    Target location for a given path under the current pucket

    Target location for a given path under the current pucket

    returns

    a fully qualified path under the current pucket, maintaining a partitioning scheme

    Definition Classes

    Pucket

30. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

31. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

32. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

33. def writer: \/[Throwable, ThriftWriter[T]]

    

    Writer implementation for the pucket.

    Writer implementation for the pucket. See com.intenthq.pucket.writer.Writer

    Definition Classes

    ThriftPucket → Pucket