Applying Advanced Techniques

This documentation discusses the application of advanced programming techniques to the development of floes and cubes.

• Introduction
• Concurrency
  • The Bottleneck problem - Why Do Cubes Stall?
  • The Bookkeeping Problem - How to merge output of subfloes
• Computational Resources
  • Transportation Costs
  • Cube Group Limitations
• Parallelization
  • When Not to Parallelize
  • Parallel Cube Groups
  • The end() Method
• Data Traffic
  • Optimizing Data Traffic
  • Buffering and Batching
  • Buffering
  • Batching
  • Buffering vs. Batching
• Collections I/O
  • Efficient Collections I/O
  • Serial Writing
  • Advanced Writing
  • Conclusion
• Summary: Optimized Floe Design