sahlberg/remote-cache.git
15 years agoinitial read/write support
Ronnie Sahlberg [Tue, 22 Jul 2008 03:50:54 +0000 (13:50 +1000)]
initial read/write support
update access to allow trying the W bit if we are in rw/ mode

15 years agoIf we detect a file no longer exists on the remote site during a GETATTR read-only read-only
Ronnie Sahlberg [Tue, 22 Jul 2008 03:42:51 +0000 (13:42 +1000)]
If we detect a file no longer exists on the remote site during a GETATTR
we also try to delete any local cached copy of it we may have

15 years agoAdd an option "--file-min-mtime-age". Files that have been modified more recently...
Ronnie Sahlberg [Tue, 22 Jul 2008 02:31:30 +0000 (12:31 +1000)]
Add an option "--file-min-mtime-age". Files that have been modified more recently than this will not be copied to the local cache.

Signed-off-by: Ronnie Sahlberg <ronniesahlberg@gmail.com>
15 years agonew version
Ronnie Sahlberg [Tue, 1 Jul 2008 01:08:14 +0000 (11:08 +1000)]
new version

add --file-check-parent-mtime argument that will activate the
optimization in attribute caching that is possible for archive systems
(== files are never modified post creation)

15 years agoget rid of util.c
Ronnie Sahlberg [Tue, 1 Jul 2008 00:51:21 +0000 (10:51 +1000)]
get rid of util.c

15 years agowe dont need this file
Ronnie Sahlberg [Tue, 1 Jul 2008 00:49:49 +0000 (10:49 +1000)]
we dont need this file

15 years agowe dont need libevents
Ronnie Sahlberg [Tue, 1 Jul 2008 00:46:43 +0000 (10:46 +1000)]
we dont need libevents

15 years agowe dont need strlist
Ronnie Sahlberg [Tue, 1 Jul 2008 00:42:17 +0000 (10:42 +1000)]
we dont need strlist

15 years agowe dotn need idtree
Ronnie Sahlberg [Tue, 1 Jul 2008 00:40:03 +0000 (10:40 +1000)]
we dotn need idtree

15 years agoRevert "we dont need util_time"
Ronnie Sahlberg [Tue, 1 Jul 2008 00:38:44 +0000 (10:38 +1000)]
Revert "we dont need util_time"

This reverts commit 312e0a55fd7d978823ac1e599f63503ba62cc3d0.

15 years agoRevert "we dont need util_file"
Ronnie Sahlberg [Tue, 1 Jul 2008 00:38:33 +0000 (10:38 +1000)]
Revert "we dont need util_file"

This reverts commit 2004b4694622b6c570dcbddf2d73709bae24ba75.

15 years agowe dont need util_file
Ronnie Sahlberg [Tue, 1 Jul 2008 00:36:44 +0000 (10:36 +1000)]
we dont need util_file

15 years agowe dont need util_time
Ronnie Sahlberg [Tue, 1 Jul 2008 00:35:38 +0000 (10:35 +1000)]
we dont need util_time

15 years agowe dont need db_wrap
Ronnie Sahlberg [Tue, 1 Jul 2008 00:34:05 +0000 (10:34 +1000)]
we dont need db_wrap

15 years agoversion 1.0.9
Ronnie Sahlberg [Mon, 23 Jun 2008 23:20:56 +0000 (09:20 +1000)]
version 1.0.9

15 years agotell fuse to use the permissions from the fiulesystekm instead of some made up ones
Ronnie Sahlberg [Mon, 23 Jun 2008 23:19:54 +0000 (09:19 +1000)]
tell fuse to use the permissions from the fiulesystekm instead of some made up ones

15 years agodont include ctdb.h we dont need this file
Ronnie Sahlberg [Fri, 20 Jun 2008 07:21:37 +0000 (17:21 +1000)]
dont include ctdb.h  we dont need this file

15 years agoupdate access() root can always read and execute
Ronnie Sahlberg [Wed, 18 Jun 2008 22:07:04 +0000 (08:07 +1000)]
update access()  root can always read and execute

15 years agopass the use_ino option to fuse
Ronnie Sahlberg [Wed, 18 Jun 2008 04:01:17 +0000 (14:01 +1000)]
pass the use_ino option to fuse

15 years agoversion 1.0.8
Ronnie Sahlberg [Wed, 18 Jun 2008 03:36:07 +0000 (13:36 +1000)]
version 1.0.8

15 years agoemulate the access() call
Ronnie Sahlberg [Wed, 18 Jun 2008 03:31:04 +0000 (13:31 +1000)]
emulate the access() call

15 years agonew version 1.0.7
Ronnie Sahlberg [Wed, 18 Jun 2008 02:23:47 +0000 (12:23 +1000)]
new version 1.0.7

15 years agoreduce the debuglevel for some messages
Ronnie Sahlberg [Wed, 18 Jun 2008 02:22:41 +0000 (12:22 +1000)]
reduce the debuglevel for some messages

15 years agowe can also verify the local cache and purge files that have expired when we process...
Ronnie Sahlberg [Wed, 18 Jun 2008 02:18:33 +0000 (12:18 +1000)]
we can also verify the local cache and purge files that have expired when we process a GETATTR

15 years agoupdate GETATTR to know how to handle file_check_parent_mtime
Ronnie Sahlberg [Wed, 18 Jun 2008 02:05:13 +0000 (12:05 +1000)]
update GETATTR to know how to handle file_check_parent_mtime

15 years agoadd new parameter --file-check-parent-mtime
Ronnie Sahlberg [Wed, 18 Jun 2008 01:47:31 +0000 (11:47 +1000)]
add new parameter --file-check-parent-mtime

15 years agonew version 1.0.6
Ronnie Sahlberg [Tue, 17 Jun 2008 02:25:35 +0000 (12:25 +1000)]
new version 1.0.6

15 years agoset the extra groups to a list with one entry, the current group
Ronnie Sahlberg [Tue, 17 Jun 2008 02:23:48 +0000 (12:23 +1000)]
set the extra groups to a list with one entry, the current group

15 years agodrop the extra groups for the process when we switch to the real user
Ronnie Sahlberg [Tue, 17 Jun 2008 01:51:17 +0000 (11:51 +1000)]
drop the extra groups for the process when we switch to the real user

15 years ago new version 1.0.5
Ronnie Sahlberg [Mon, 16 Jun 2008 05:16:32 +0000 (15:16 +1000)]
 new version 1.0.5

15 years agowhen reading a directory from a remote site,
Ronnie Sahlberg [Mon, 16 Jun 2008 05:04:33 +0000 (15:04 +1000)]
when reading a directory from a remote site,
read it as root and build the local cache
then try again and switch to the real user uid to read from the cache

15 years agoswitch to the real user and obey the permissions when reading a directory from the...
Ronnie Sahlberg [Mon, 16 Jun 2008 04:31:22 +0000 (14:31 +1000)]
switch to the real user and obey the permissions when reading a directory from the cache

15 years agowhen emulating a read() check the stats for the file attributes before we switch...
Ronnie Sahlberg [Mon, 16 Jun 2008 03:07:03 +0000 (13:07 +1000)]
when emulating a read() check the stats for the file attributes before we switch to the real user

15 years agoRevert "even if the user is not allowed to read the file due to permissions"
Ronnie Sahlberg [Mon, 16 Jun 2008 01:55:01 +0000 (11:55 +1000)]
Revert "even if the user is not allowed to read the file due to permissions"
This should actually not be doine since it would allow a user an easy dos attack
by just trying to and failing to read files  causing migration and filling up the cache

This reverts commit be8a1ef2cf47279d24ddc8401a7d5541e15e933c.

15 years agoeven if the user is not allowed to read the file due to permissions
Ronnie Sahlberg [Mon, 16 Jun 2008 01:51:03 +0000 (11:51 +1000)]
even if the user is not allowed to read the file due to permissions
try to migrate the file anyway

15 years agowhen we create a cache for a directory, make sur ethe directory cache file
Ronnie Sahlberg [Mon, 16 Jun 2008 01:44:59 +0000 (11:44 +1000)]
when we create a cache for a directory, make sur ethe directory cache file
has the same owner/group and permissions as the directory itself

15 years agowhen creating a cache directory, make sure it gets the right uid/gid/mode
Ronnie Sahlberg [Mon, 16 Jun 2008 01:01:42 +0000 (11:01 +1000)]
when creating a cache directory, make sure it gets the right uid/gid/mode

15 years agochangelog must change in monoton fashion or the build will fail
Ronnie Sahlberg [Fri, 13 Jun 2008 01:24:46 +0000 (11:24 +1000)]
changelog must change in monoton fashion or the build will fail

15 years agonew version
Ronnie Sahlberg [Fri, 13 Jun 2008 01:20:59 +0000 (11:20 +1000)]
new version

15 years agowhen we change to a different user/gid
Ronnie Sahlberg [Fri, 13 Jun 2008 01:19:41 +0000 (11:19 +1000)]
when we change to a different user/gid

change the gid first  while we are still root
before we switch the uid  since once we are no longer root
we wont be able to change gid anymore

15 years agofix typos
Ronnie Sahlberg [Fri, 13 Jun 2008 00:31:43 +0000 (10:31 +1000)]
fix typos

16 years agoupdate to 1.0.3
Ronnie Sahlberg [Tue, 10 Jun 2008 03:33:40 +0000 (13:33 +1000)]
update to 1.0.3

16 years agoadd a new parameter
Ronnie Sahlberg [Tue, 10 Jun 2008 03:27:52 +0000 (13:27 +1000)]
add a new parameter
--file-max-size

that specifies the maximum size of files to add to the cache. files
larger than this will not be cached.

add rate limitation to the log messages for when we are not caching
due to filesize too big or not enough inodes/blocks left in the cache
filesystem

16 years agoadd two more parameters
Ronnie Sahlberg [Tue, 10 Jun 2008 02:51:16 +0000 (12:51 +1000)]
add two more parameters
--file-min-blocks
--file-min-inodes

when less than these numbers of blocks/inodes are available in the cache filesystem remote-cache will no longer add more files to the cache.

16 years agoadd two new command line arguments
Ronnie Sahlberg [Tue, 10 Jun 2008 02:35:45 +0000 (12:35 +1000)]
add two new command line arguments
--dir-min-inodes
--dir-min-blocks

when less than this number of blocks/inodes are available in the cache filesyste
m
we stop adding more directories to the local cache.
directories can still be accessed (slowly) by clients  but will not be cached locally

16 years agowhen emulating READDIR(),
Ronnie Sahlberg [Tue, 10 Jun 2008 02:15:35 +0000 (12:15 +1000)]
when emulating READDIR(),
if we dont have a local cache of the directory and we the cache
filesystem is full, then dont even try to build a local cache.

Just read slowly from the remote side and log a message to the effect that
the cache is full.

16 years agocheck that --export, --cache and --remote all exist and are all directories
Ronnie Sahlberg [Tue, 10 Jun 2008 01:08:56 +0000 (11:08 +1000)]
check that --export, --cache and --remote all exist and are all directories

16 years agoadd a new argument --max-dir-cache=SECONDS
Ronnie Sahlberg [Wed, 4 Jun 2008 02:26:55 +0000 (12:26 +1000)]
add a new argument --max-dir-cache=SECONDS
which controls the maximum length of time a directory structure will be cached
before the directory will be flushed and re-read.

it defaults to 0, maintaining the previous semantics of caching the directory
content and the child object attributes forever (or until mtime changes)

16 years agomust create the _mandir/man1 directory when building the rpm
Ronnie Sahlberg [Wed, 28 May 2008 00:31:32 +0000 (10:31 +1000)]
must create the _mandir/man1 directory when building the rpm

16 years agoupdate to version 1.0.2
Ronnie Sahlberg [Wed, 28 May 2008 00:26:36 +0000 (10:26 +1000)]
update to version 1.0.2

16 years agoadd gpl boilerplate
Ronnie Sahlberg [Wed, 28 May 2008 00:25:39 +0000 (10:25 +1000)]
add gpl boilerplate

16 years agoadd a simple manpage to remote-cache
Ronnie Sahlberg [Wed, 28 May 2008 00:24:14 +0000 (10:24 +1000)]
add a simple manpage to remote-cache

16 years agowe have to defer redirecting stderr to the logfile until after fuse has started
Ronnie Sahlberg [Tue, 27 May 2008 04:38:49 +0000 (14:38 +1000)]
we have to defer redirecting stderr to the logfile until after fuse has started
or else the stderr will be closed by fuse runtime when it starts up

16 years agoupdate version
Ronnie Sahlberg [Tue, 27 May 2008 04:12:32 +0000 (14:12 +1000)]
update version

16 years agoadd setting of debug level through -d or --debug
Ronnie Sahlberg [Tue, 27 May 2008 04:08:31 +0000 (14:08 +1000)]
add setting of debug level through -d or --debug

log all messages to /var/log/log.remote_cache

16 years agostart using popt to parse arguments
Ronnie Sahlberg [Tue, 27 May 2008 03:39:13 +0000 (13:39 +1000)]
start using popt to parse arguments

this changes how to start remote-cache

it must now be invoked using :
remote-cache --export=<dir> --cache=<dir> --remote=<dir>

16 years agoprint the remote-cache version on startup
Ronnie Sahlberg [Tue, 27 May 2008 01:57:59 +0000 (11:57 +1000)]
print the remote-cache version on startup

16 years agocreate the bin directory to write the executable to
Ronnie Sahlberg [Tue, 27 May 2008 01:11:42 +0000 (11:11 +1000)]
create the bin directory to write the executable to

16 years agomkrpm bugfix
Ronnie Sahlberg [Tue, 27 May 2008 01:02:40 +0000 (11:02 +1000)]
mkrpm bugfix

16 years agoadd a makerpms.sh script
Ronnie Sahlberg [Tue, 27 May 2008 00:58:24 +0000 (10:58 +1000)]
add a makerpms.sh script

16 years agoadd an initial specfile for remote-cache
Ronnie Sahlberg [Tue, 27 May 2008 00:57:42 +0000 (10:57 +1000)]
add an initial specfile for remote-cache

16 years agoadd an "install" target
Ronnie Sahlberg [Tue, 27 May 2008 00:57:01 +0000 (10:57 +1000)]
add an "install" target

16 years agoremove references to gpfs and the migrate tool
Ronnie Sahlberg [Tue, 27 May 2008 00:39:24 +0000 (10:39 +1000)]
remove references to gpfs and the migrate tool
this will become a dedicated remote-cache repository

16 years agoif readdir fails, delete the local cache for the directory. origin/HEAD origin/master
Ronnie Sahlberg [Wed, 21 May 2008 00:00:42 +0000 (10:00 +1000)]
if readdir fails, delete the local cache for the directory.

16 years agodefer setting up the sigchild handler until just prior to when we do the first fork()
Ronnie Sahlberg [Tue, 20 May 2008 23:42:31 +0000 (09:42 +1000)]
defer setting up the sigchild handler until just prior to when we do the first fork()

16 years agoalso switch the egid when we switch from root to a user
Ronnie Sahlberg [Tue, 20 May 2008 23:34:45 +0000 (09:34 +1000)]
also switch the egid when we switch from root to a user

16 years agoextract the switching to/from real user and root into separate functions
Ronnie Sahlberg [Tue, 20 May 2008 23:32:01 +0000 (09:32 +1000)]
extract the switching to/from real user and root into separate functions

16 years agochange to the correct user when doing access() to the remote server
Ronnie Sahlberg [Tue, 20 May 2008 23:27:27 +0000 (09:27 +1000)]
change to the correct user when doing access() to the remote server

16 years agotallocifications
Ronnie Sahlberg [Tue, 20 May 2008 03:34:45 +0000 (13:34 +1000)]
tallocifications

16 years agotallocifications
Ronnie Sahlberg [Tue, 20 May 2008 03:27:23 +0000 (13:27 +1000)]
tallocifications

16 years agotallocifications
Ronnie Sahlberg [Tue, 20 May 2008 03:20:11 +0000 (13:20 +1000)]
tallocifications

16 years agomore tallocifications
Ronnie Sahlberg [Tue, 20 May 2008 03:16:11 +0000 (13:16 +1000)]
more tallocifications

16 years agouse a proper signal handler to reap dead child processes
Ronnie Sahlberg [Tue, 20 May 2008 01:12:11 +0000 (11:12 +1000)]
use a proper signal handler to reap dead child processes

16 years agodont need to modify argv[] anymore since we use a separate fuse_argv[]
Ronnie Sahlberg [Tue, 20 May 2008 00:37:47 +0000 (10:37 +1000)]
dont need to modify argv[] anymore since we use a separate fuse_argv[]

16 years agowhen mounting the fuse filesystem, add a -oallow_other by default
Ronnie Sahlberg [Tue, 20 May 2008 00:22:41 +0000 (10:22 +1000)]
when mounting the fuse filesystem, add a -oallow_other by default
so that also non root users can access the share

add locking to when building the directory cache

16 years agotallocifications
Ronnie Sahlberg [Mon, 19 May 2008 03:13:43 +0000 (13:13 +1000)]
tallocifications

16 years agomore tallocifications
Ronnie Sahlberg [Mon, 19 May 2008 03:07:48 +0000 (13:07 +1000)]
more tallocifications

16 years agomore tallocifications
Ronnie Sahlberg [Mon, 19 May 2008 03:05:04 +0000 (13:05 +1000)]
more tallocifications

16 years agodebug updates
Ronnie Sahlberg [Mon, 19 May 2008 03:02:53 +0000 (13:02 +1000)]
debug updates

16 years agotallocify _mknod()
Ronnie Sahlberg [Mon, 19 May 2008 02:58:17 +0000 (12:58 +1000)]
tallocify _mknod()

16 years agotallocify _symlink()
Ronnie Sahlberg [Mon, 19 May 2008 02:57:00 +0000 (12:57 +1000)]
tallocify _symlink()

16 years agotallocify _rename()
Ronnie Sahlberg [Mon, 19 May 2008 02:55:31 +0000 (12:55 +1000)]
tallocify _rename()

16 years agoadd back the miration tool
Ronnie Sahlberg [Mon, 19 May 2008 00:49:33 +0000 (10:49 +1000)]
add back the miration tool

16 years agoadd some link flags
Ronnie Sahlberg [Sun, 18 May 2008 22:59:18 +0000 (08:59 +1000)]
add some link flags

16 years agoAdd migrate tool back to the build
Ronnie Sahlberg [Fri, 16 May 2008 04:16:56 +0000 (14:16 +1000)]
Add migrate tool back to the build

16 years agoadd a limiter so we wont try to migrate more than 100 files at a time
Ronnie Sahlberg [Tue, 29 Apr 2008 21:19:06 +0000 (07:19 +1000)]
add a limiter so we wont try to migrate more than 100 files at a time

fix a bug with the rsync command we generate

16 years agoupdate configure
root [Tue, 8 Apr 2008 22:05:38 +0000 (08:05 +1000)]
update configure

16 years agoremove some files we dont need
root [Tue, 8 Apr 2008 21:59:19 +0000 (07:59 +1000)]
remove some files we dont need

16 years agoupdates to remote read-only cache
root [Tue, 8 Apr 2008 21:57:43 +0000 (07:57 +1000)]
updates to remote read-only cache

16 years agomore migration updates origin/origin
Ronnie Sahlberg [Sun, 6 Apr 2008 22:08:29 +0000 (08:08 +1000)]
more migration updates

16 years agoupdates
Ronnie Sahlberg [Thu, 13 Mar 2008 23:02:02 +0000 (10:02 +1100)]
updates

16 years agoupdates
Ronnie Sahlberg [Thu, 13 Mar 2008 22:43:38 +0000 (09:43 +1100)]
updates

16 years agoadd some
Ronnie Sahlberg [Thu, 13 Mar 2008 22:20:24 +0000 (09:20 +1100)]
add some

16 years agoremove some more stuff
Ronnie Sahlberg [Thu, 13 Mar 2008 22:05:01 +0000 (09:05 +1100)]
remove some more stuff

16 years agoremove web directory
Ronnie Sahlberg [Thu, 13 Mar 2008 22:03:14 +0000 (09:03 +1100)]
remove web directory

16 years agoinitial migrate tree. copy of ctdb-git
Ronnie Sahlberg [Thu, 13 Mar 2008 22:02:11 +0000 (09:02 +1100)]
initial migrate tree.    copy of ctdb-git

16 years agoadd tdb to the fuse tree
Ronnie Sahlberg [Thu, 13 Mar 2008 21:54:14 +0000 (08:54 +1100)]
add tdb to the fuse tree