Re: limiting the number of cpu's used by spacy

From: Adam Constabaris <adam_constabaris_at_nyob>
Date: Tue, 29 May 2018 09:09:54 -0400
To: CODE4LIB_at_LISTS.CLIR.ORG
Eric,

I don't know if spacy has anything built in for this, but I'd recommend
going in the direction suggested by Flannon and one of the answers on Stack
Overflow, and use your OS to do the limiting, if it supports that.

If your goal is specifically to limit the *number* of CPUs a process can
use, on Linux the commands to look at are numactl and taskset:
http://www.glennklockwood.com/hpc-howtos/process-affinity.html

good luck

AC






On Fri, May 25, 2018 at 5:50 PM, Eric Lease Morgan <emorgan_at_nd.edu> wrote:

> On Stack exchange I asked "How do I limit the number of CPU's used by
> Spacy?", a set of Python-based natural language processing modules. [1] And
> I thought I might ask it here as well. Any ideas?
>
> [1] https://stackoverflow.com/q/50537146/7691778
>
> --
> Eric Morgan
>
Received on Tue May 29 2018 - 09:11:42 EDT