Re: efficiency using categorical data
On 4/11/17 2:49 PM, Bruce Elliott wrote:> This works well for memory usage - I'm now using about 10% of the memory> previously used with the non-categorical data - but it's taking far> longer...
View ArticleRe: efficiency using categorical data
I'm coming into this thread kind of late. Let me say a few things here about memory. I'll post separately about performance. On 4/11/17 2:49 PM, Bruce Elliott wrote:> I've been experimenting with...
View ArticleRe: efficiency using categorical data
On 04/12/2017 4:27 PM, Bruce Elliott wrote: ...> It sounds like the benefits for memory efficiency increase with larger> array sizes, but then there might be a performance hit, since the>...
View ArticleRe: efficiency using categorical data
"Yair Altman" wrote in message <ocm19f$n6v$1@newscl01ah.mathworks.com>...> > Duplicating a long string multiple time is indeed wasteful in memory. Storing a cell array of unique strings and...
View ArticleRe: efficiency using categorical data
On 04/12/2017 3:05 PM, Yair Altman wrote: ...> ... This goes back to my> point that the real tradeoff here is maintainability and dev time/cost> vs. performance and memory. There are no free...
View ArticleRe: efficiency using categorical data
"Bruce Elliott" wrote in message <oclr6e$a7l$1@newscl01ah.mathworks.com>...> "Yair Altman" wrote in message <ocli7j$k5c$1@newscl01ah.mathworks.com>...> > Categorical data and...
View ArticleRe: efficiency using categorical data
On 04/12/2017 1:21 PM, Bruce Elliott wrote:> "Yair Altman" wrote in message <ocli7j$k5c$1@newscl01ah.mathworks.com>...>> Categorical data and tables in general use more memory and are...
View ArticleRe: efficiency using categorical data
"Yair Altman" wrote in message <ocli7j$k5c$1@newscl01ah.mathworks.com>...> Categorical data and tables in general use more memory and are less performant than the corresponding implementation...
View ArticleRe: efficiency using categorical data
On 04/12/2017 10:48 AM, Yair Altman wrote: ...> Categorical data and tables in general use more memory and are less> performant than the corresponding implementation using simple arrays. So>...
View ArticleRe: efficiency using categorical data
"Bruce Elliott" wrote in message <ocldp3$akt$1@newscl01ah.mathworks.com>...> "dpb" wrote in message <ocjbvg$rsr$1@dont-email.me>...> > "There is no free lunch". I have observed...
View ArticleRe: efficiency using categorical data
"dpb" wrote in message <ocjbvg$rsr$1@dont-email.me>...> "There is no free lunch". I have observed that categorical are slow > even with just some small toy datasets. I think it's likely...
View ArticleRe: efficiency using categorical data
On 04/11/2017 1:49 PM, Bruce Elliott wrote: ..> Does all this sound correct? Should I expect a slow-down in processing> categorical data in exchange for less memory use? "There is no free lunch"....
View Articleefficiency using categorical data
I've been experimenting with converting some older code to use categorical data to reduce memory use, but it seems to be causing unexpected slow-down in processing time. I'm wondering if this is...
View ArticleRe: suggestion for alternate syntax for table indexing
On 04/06/2017 3:01 PM, Bruce Elliott wrote: ...> I'd like to be able to index into rows of a table using logical indexing> on certain values in the table. Since the variables are in the table,...
View Articlesuggestion for alternate syntax for table indexing
I have an idea for a feature request, but I thought I'd toss it out to this group first for feedback, in case it's already been done or if it's just a dumb idea for any reason. I'd like to be able to...
View ArticleRe: Deleting Table Rows containing blank cells
Depending on what your table looks like, you should be able to do what rmmissing does with rowfun, by using 'OutputFormat','uniform' and a function that returns a scalar logical if all it's inputs are...
View ArticleDeleting Table Rows containing blank cells
Hi there, I'm trying to clean excel files to remove all rows with blank cells. I have many excel files so ideally need to write a script whereby I can type the file name and a new 'clean' file is...
View ArticleRe: How avoid a loop for in a table?
On 12/22/2016 3:06 AM, Adriano wrote:> Hi everyone,>> I have a very big table called "export" (more than 2000000 rows) with a> column of dates called "expiration" and I have this part of...
View ArticleHow avoid a loop for in a table?
Hi everyone, I have a very big table called "export" (more than 2000000 rows) with a column of dates called "expiration" and I have this part of code: for i 1:size(export,1) if...
View Articletable datatype
The table class provides a very handy way to display tabular data. It provides for VariableUnits and VariableDescriptions but as far as I can find it only uses these quantities with the relatively...
View Article
![Various Artists – Old School / New School [iTunes Plus M4A]](http://i.imgur.com/GEFz815.jpeg)
![[Prime] Osprey Daylite Travel Pack 35 - Nightshift Blue $135 (RRP $199)...](http://files.ozbargain.com.au/n/87/976987l.jpg?h=1a642bba)