Feature Request: Enhance FireDucks DataFrame with a native memory_usage() method.
Background: Currently, invoking memory_usage() on a FireDucks DataFrame defaults to pandas, leading to potential inaccuracies due to data copying between frameworks. This makes precise memory profiling challenging.
Proposed Solution: Develop an internal memory_usage() function within FireDucks to provide accurate memory consumption metrics without falling back on pandas.
Benefit: This feature will enable users to effectively monitor and optimize memory usage, especially when handling large datasets.
Reference: As per the discussion with @qsourav on LinkedIn.
Feature Request: Enhance FireDucks DataFrame with a native
memory_usage()method.Background: Currently, invoking
memory_usage()on a FireDucks DataFrame defaults to pandas, leading to potential inaccuracies due to data copying between frameworks. This makes precise memory profiling challenging.Proposed Solution: Develop an internal
memory_usage()function within FireDucks to provide accurate memory consumption metrics without falling back on pandas.Benefit: This feature will enable users to effectively monitor and optimize memory usage, especially when handling large datasets.
Reference: As per the discussion with @qsourav on LinkedIn.