Stack Overflow
Stack Overflow

Questions tagged [stxxl]

STXXL is an open source out-of-core implementation of the STL, that is available for all major desktop operating systems under the Boost Software License 1.0.

STXXL is an open source out-of-core implementation of the containers, that are part of the C++ STL. It is released under the Boost Software License 1.0 and available for Linux, Mac OS X, Free BSD and Windows (2000 upwards).

52 questions
0
votes
1 answer

Stxxl Vector as dropin replacement for std::vector

This is a followup of Vector of pairs with generic vector and pair type, template of template. I'd like to be able to call a method with a std::vector or stxxl:vector, while template arguments of the vector (Pair of x,y) are specified. Specifically…
Jan B
  • 518
  • 1
  • 3
  • 18
0
votes
1 answer

Combining Streams and Iteration in STXXL

STXXL supports a streaming model of data processing. STXXL data can either be processed by iterating through it (e.g. using stxxl::for_each), or by converting to a stream mode (e.g. using streamify() where such stream transforms can be composed for…
Adi Shavit
  • 16,743
  • 5
  • 67
  • 137
0
votes
0 answers

Stxxl map with std::string as key and std::vector as value

I need a large map of sets of numbers. So i'm using stxxl and it's basically something like map>. The key is 3-letters identifier. There are about 3k enteries in the map, and each of them can contain up to 500K…
flyman
  • 210
  • 4
  • 15
0
votes
1 answer

Mapping an stxxl::vector to a File with Header

I have a large binary (STL) file that begins with a known and fixed size header and then continues with a bunch of fixed size buffers (PODs) representing consecutive records. I want to map the record part of the file to an stxxl::vector for fast…
Adi Shavit
  • 16,743
  • 5
  • 67
  • 137
0
votes
1 answer

Changing the size of stxxl:vector cache

In my algorithm I have two stages: 1) Populating a file with records using a big data structure X that takes as much RAM as possible 2) Sorting the file. Now there is lot of memory since X is deallocated So I would like to handle file and its…
Ilia Minkin
  • 11
  • 3
0
votes
1 answer

Why do creating pointer to instances beyond certain number(30) of a 'Structure' with 'stxxl:Vector' as one of its DataType fails?

I am using STXXL Library's stxxl::vector in my code as : struct B { typedef stxxl::VECTOR_GENERATOR::result vector; vector content; }; And then creating many instances of the above declared Structure in a loop using the following…
Akif Khan
  • 53
  • 8
0
votes
1 answer

STXXL Dealing with strings

i am dealing with large dataset. May i ask you how it is possible to store strings in the classes i want to use with stxxl? I have read several discussions and everywhere was said that string is not POD type therefore it cannot be stored in the…
brano199
  • 1
  • 1
0
votes
1 answer

stxxl save and read vector from disk file

I'm struggling in trying to use the stxxl library in a way, that I cannot only store the data from their vector structure into a file but also recover it from that file in a rerun of my program. I found out that you can construct a vector from a…
Kasastran
  • 23
  • 3
0
votes
1 answer

Parallelizing STXXL Container

I am trying to use STXXL to build a large matrix and be able to perform several different operations on the matrix. Currently, I'm using stxxl::vector as a way of storing submatrices of my large matrix. What I'm attempting to do is to normalize each…
mculp
  • 59
  • 1
  • 7
0
votes
1 answer

How to delete a STXXL priority queue?

I created a STXXL priority queue in my program. If I do not need the PQ any more, how to delete it? Just like delete[] buffer in C++. I want to free the memory used by it. I looked through their examples and description, but I cannot find the…
Charlie
  • 3
  • 2
0
votes
5 answers

Handling large amounts of data in C++, need approach

So I have a 1GB file in a CSV format like so, that I converted to a SQLite3 database column1;column2;column3 1212;abcd;20090909 1543;efgh;20120120 Except that I have 12 columns. Now, I need to read and sort this data and reformat it for output, but…
user3195734
  • 145
  • 2
  • 7
0
votes
0 answers

STXXL disk allocation error Windows7

I am trying to use stxxl in windows 7 - MSVC12 Express. If I do not give the config file (.stxxl.txt): the program initiates by [STXXL-MSG] STXXL v1.4.0 (prerelease/) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk…
user3319630
  • 1
  • 1
0
votes
2 answers

Working with stxxl in multiple threads

The following program, crashes with libc++abi.dylib: terminating with uncaught exception of type stxxl::io_error: Error in virtual void stxxl::ufs_file_base::lock() : fcntl(,F_SETLK,) path=/var/tmp/stxxl fd=5 : Resource temporarily unavailable:…
Martin Kristiansen
  • 9,875
  • 10
  • 51
  • 83
0
votes
2 answers

Is it possible to define the length of the type to sort in STXXL at run time?

I have an application that requires a built-in sort and I'm hoping to replace the existing sort mechanism with the sort provided by STXXL. I have successfully tested it using STXXL, but my problem is that, although a specific run of the sort needs…
MarkI
  • 3
  • 2
0
votes
1 answer

Cannot build STXXL with CMake

It seems that I cannot build the solution for STXXL with CMake 2.8.12.1. I looked at all the articles and followed their instructions but no luck. I have VS2010 Professional with SP1 and Windows 7. I select Visual Studio 10 Win64 in CMake and click…
Dimitris
  • 2,030
  • 3
  • 27
  • 45
1 2
3
4