all messages for Emacs-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
* Emacs/ESS/org freezes/hangs on big data/ RAM(~256GB) processes when run in org/babel
@ 2015-06-17 19:09 Xebar Saram
  2015-06-17 19:19 ` William Denton
  0 siblings, 1 reply; 13+ messages in thread
From: Xebar Saram @ 2015-06-17 19:09 UTC (permalink / raw)
  To: org mode

[-- Attachment #1: Type: text/plain, Size: 1633 bytes --]

Hi all

im not sure if this is absolutely the correct forum to raise this and if
not would be also happy to get input on where to persue this issue.

i recently dived into using orgmode, ESS, Babel etc to run code and im
really love it. The problem i have (and im not sure if its a org,Emacs or
ess issue) is that emacs sometimes (and mostly when dealing with R
processes involving HUGE databases) will just hang/freeze.

I do alot of modeling work that involves using huge datasets and run
process intensive R processes (such as complex mixed models, Gamms etc). in
R studio all works well yet when i use the orgmode eval on R code blocks it
works well for small simple process but 90% of the time when dealing with
complex models and bug data (up to 256GB) it will just freeze emacs/ess.
sometimes i can C-c or C-g it and other times i need to physically kill
emacs.

here is an example of such process that hangs


**** lmer
run the lmer part regressing stage 2 pred Vs mean pm

#+BEGIN_SRC R  :session Rorg  :results none
m2.smooth = lme(pred.m2 ~ meanPM25,random = list(aodid= ~1 +
meanPM25),control=lmeControl(opt = "optim"), data= mod2 )
#correlate to see everything from mod2 and the mpm works
mod2[, pred.t31 := predict(m2.smooth)]
mod2[, resid  := residuals(m2.smooth)]
print(summary(lm(pred.m2~pred.t31,data=mod2))$r.squared)
#+END_SRC

i usually issue org-babel-execute-subtree to eval several subsections under
a main header.

again i dont know if its an org mode isse perse but would love to hear from
people that have experience using R/org with big data/RAM and maybe point
me to where to raise these issues

best

Z

[-- Attachment #2: Type: text/html, Size: 2005 bytes --]

^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2015-06-20 21:20 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-06-17 19:09 Emacs/ESS/org freezes/hangs on big data/ RAM(~256GB) processes when run in org/babel Xebar Saram
2015-06-17 19:19 ` William Denton
2015-06-18  3:17   ` Charles C. Berry
2015-06-18 11:39     ` Xebar Saram
2015-06-18 18:45       ` Charles C. Berry
2015-06-18 12:34     ` Rainer M Krug
2015-06-18 20:20       ` Charles C. Berry
2015-06-18 21:20         ` Andreas Leha
2015-06-19 22:13           ` Charles C. Berry
2015-06-19 22:25             ` Andreas Leha
2015-06-19 22:31       ` Andreas Leha
2015-06-20 15:05         ` Rainer M Krug
2015-06-20 21:20           ` Andreas Leha

Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/emacs.git
	https://git.savannah.gnu.org/cgit/emacs/org-mode.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.