Skip to content

Implement memory_usage() Method for Accurate FireDucks DataFrame Memory Measurement #65

Description

@rohit172001-eng

Feature Request: Enhance FireDucks DataFrame with a native memory_usage() method.

Background: Currently, invoking memory_usage() on a FireDucks DataFrame defaults to pandas, leading to potential inaccuracies due to data copying between frameworks. This makes precise memory profiling challenging.

Proposed Solution: Develop an internal memory_usage() function within FireDucks to provide accurate memory consumption metrics without falling back on pandas.

Benefit: This feature will enable users to effectively monitor and optimize memory usage, especially when handling large datasets.

Reference: As per the discussion with @qsourav on LinkedIn.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Fields

No fields configured for Feature.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions