Questions tagged [files]

Organized data encoded in a pre-defined format and stored on a filesystem.

In the computational sense, one-dimensional array of bytes stored in a filesystem, typically encoded a pre-defined format, often indicated by a file-extension or "magic number". More "durable" than in-memory storage.

677 questions
7
votes
2 answers

Unix sort for partially ordered data sets

So I have an enormously large file (around 10GB) and need to sort it, just like in using 'sort' utility, but kindof more effectively. Problem is, that I don't have memory, CPU power, time, nor free swapping space to power the whole sort. The good…
exa
  • 571
  • 4
  • 14
7
votes
2 answers

Import a 260GB csv file into MySQL

I have a really big csv ~260GB and I want to import it into MySQL. I use the following mysql script in MacOS DROP TABLE IF EXISTS tmp_catpath_5; create table tmp_catpath_5( a1 BIGINT(20),a2 BIGINT(20),a3 BIGINT(20),a4 BIGINT(20),a5 BIGINT(20), …
jimkont
  • 173
  • 1
  • 6
7
votes
6 answers

Delete temporary files from batch script in xp

I'm looking for a good batch script that would quickly find & clean all the known safe temporary folders/files from Windows (as many variants as possible) machines (e.g. the windows temp folder, all users IE temp folders, etc.). I'm fond of UI tools…
Keith Bentrup
  • 719
  • 3
  • 8
  • 19
7
votes
1 answer

How to get number of files open in Ubuntu?

I would like to know if there is some utility that can show how many open files I have on an Ubuntu server?
arikfr
  • 369
  • 2
  • 5
  • 16
6
votes
0 answers

Log file rotation and "tail -f"

I use log4j to create rolling log files from my program. It writes to a log file until it reaches 256mb, and then it renames all the log files and creates a new log file and continues logging. It is very useful for me to monitor these log files…
DivideByHero
  • 371
  • 1
  • 3
  • 8
6
votes
2 answers

Options for scalable file storage (Windows Server)

We currently have a windows server that stores images for a web project. The project has been really successful and we are seeing performance issues and we will obviously run out of space in the future with the current 100k or so images we have…
LiamB
  • 270
  • 5
  • 13
6
votes
5 answers

Force file deletion on Windows

Often on my development workstation (on which I am administrator and the only user), I am unable to delete files by deleting the root folder - despite having recursively taken ownership of the tree. I am presuming that this is due to the file being…
Sean Kearon
  • 217
  • 1
  • 6
6
votes
3 answers

Sorting large binary files

Is there Unix utility for sorting large files containing fixed length binary records? In other words, I'm looking for something like sort(1) but for binary files with fixed length records. I could convert the files into text, then sort using…
HughE
  • 163
  • 1
  • 4
6
votes
8 answers

Monitor File Changes On Windows System

I am looking for a utility that can take a snapshot of the files in directories that I am interested in and then compare that snapshot to the current state of the system and show me any files that have been added, changed, or deleted. Does anyone…
user10487
6
votes
4 answers

Automatic Notification of New or Changed Files in a Folder or Share

I'm looking for some Open Source [free] or relatively inexpensive solution for monitoring specific folders on a file system and 'Windows' network with several shares. When a file is added or changed, I would like to be able to notify myself and/or…
Dave Drager
  • 8,375
  • 29
  • 45
6
votes
1 answer

Dovecot IMAP indexes are getting locked by Blackberry devices

This is an odd issue that I tend to see with Blackberry devices connecting via IMAP on some of my Sendmail+Dovecot mail deployments. For users of those devices, the Dovecot indexes tend to get locked. This prevents mail flow to the Blackberry device…
ewwhite
  • 197,159
  • 92
  • 443
  • 809
6
votes
2 answers

How do I get the last part of directory from a command line

How do I store the last part of directory in a variable? For example I have the following path: A\B\C\D, I want to store D in variable like file_name=D.
Mohammad AL-Rawabdeh
  • 1,612
  • 12
  • 33
  • 54
6
votes
2 answers

Cron and rsync using file lock but is there a better way on Mac OS X Server?

I have this bash script and is run via cron on a regular interval: #!/bin/bash RSYNC=/usr/bin/rsync SSH=/usr/bin/ssh KEY=/Users/admin/Documents/Backup/rsync-key RUSER=philosophy RHOST=example.com RPATH=data/ LPATH="/Volumes/G Technology G Speed…
Scott
  • 359
  • 1
  • 5
  • 18
6
votes
3 answers

Stopping too long filenames in Windows Server 2003

We're finding a problem with long filenames, usually on "My Documents" or on shared drives. Basically, it seems that a document could be written that has a very long filename, and saved say in "My Documents". Which is fine on that computer, the…
Tubs
  • 1,204
  • 3
  • 12
  • 19