-
Notifications
You must be signed in to change notification settings - Fork 12
/
Copy pathRELNOTES
2339 lines (1882 loc) · 76.4 KB
/
RELNOTES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Release note for Gfarm 2.8.6
============================
[2024.12.16]
New environment variable
* GFARM_SASL_USER, GFARM_SASL_PASSWORD, GFARM_SASL_MECHANISMS,
GFARM_SASL_REAML
Updated feature
* gfptar - --update and --append options and many other enhancements,
see the manual page of gfptar(1) or gfptar --help.
* gfptar - reduce memory consumption
* adjust log level
Bug fix
* gfptar - fix issues of file names containing sharps and semicolons,
and long multi-bytes file names
* gfptar - fix possible stall when I/O error occurs
* gfjournal - fix assersion failure with -l option, introduced in the
version 2.8.0
* gfsd - fix noisy error log if inter-gfsd connection is encrypted [#1164]
Release note for Gfarm 2.8.5
============================
[2024.9.4]
New configuration directive
* log_tls_verbose to display verbose messages in TLS
* metadb_backend_sync_commit_at_initialization to disable asynchronous
commit at initialization.
Updated feature
* gfrm - -v option to print file names to be deleted
* gfmd - improve the startup time by asynchronous commits to flush
uncommitted journals
* improve log messages in TLS and SASL authentication
* log related directives, log_level, log_message_verbose_level,
log_auth_verbose, log_tls_verbose, can be modified by gfstatus in
runtime
Bug fix
* gfpcopy - preserve times when the file size is larger than 1 GiB by
default, introduced in the version 2.8.0
Release note for Gfarm 2.8.4
============================
[2024.3.26]
Updated feature
* gfmd - adjust log level
Bug fix
* gfmd - fix possible segfault, introduced in the version 2.8.1
Release note for Gfarm 2.8.3
============================
[2024.2.20]
Updated feature
* gfperf - allow new authentication methods. support PHP7 or later
Bug fix
* When SASL authentication fails, do not proceed to the next
authentication method
Release note for Gfarm 2.8.2
============================
[2023.12.30]
Bug fix
* gfmd - synchronous slaves may be recognized as asyncronous slaves,
introduced by the version 2.7.21
Release note for Gfarm 2.8.1
============================
[2023.12.14]
New configuration directive
* protocol_compat - use older version of protocols. specify 2.7.13 to
access older servers in shared secret authentication [#1153]
New utility
* jwt-parse - display a JSON Web Token and check expiration
Documentation
* SETUP and Gfarm-FAQ - update for Gfarm 2.8
* user/auth - SASL (OAuth2) authentication in TLS
Updated feature
* gfptar - ignore errors as the original tar behavior [#1162]
* gfmd - create file replicas first for files that fail to create file
replicas on file close [#1160]
* libgfarm - recover backward compatibility in GSI
Bug fix
* gfptar - fix runtime error "release unlocked lock"
* gfarmbb - fix gfarmbb start stops
* gfhost - may fail with segmentation fault [#1158]
* libgfarm - SASL client-side authentication is not thread-safe
[#1157]
* libgfarm - gfarm_humanize_number_to_int64() may fail
* build directory feature in Make is broken
* unconfig-gfarm.sh, unconfig-gfsd.sh - fix -t option
* gfarm-gridftp-dsi does not work since Gfarm 2.8.0 [#1155]
Release note for Gfarm 2.8.0
============================
[2023.9.3]
Update note
* this release requires config-gfarm-update --update
New feature
* Transport Layer Security (TLS) for secure communication
* New authentication methods - SASL (XOAUTH2, PLAIN, ANONYMOUS) and
Kerberos
* Multitenant support
New command
* gfcp - copy a file in parallel
* gfpconcat - concatinate files in parallel
New authentication method
* sasl_auth, sasl - SASL (XOAUTH2, PLAIN, ANONYMOUS) authentication in
TLS. After the authentication, sasl_auth uses a plain socket, while
sasl uses TLS secure connection.
* tls_sharedsecret, tls_client_certificate - shared secret and client
certificate authentications in TLS. Afther the authentication, both
uses TLS secure connection.
* kerberos_auth, kerberos - Kerberos authentication. After the
authentication, kerberos_auth uses a plain socket, while kerberos
uses Kerberos encrypted connection.
New configuration directive
* auth_trial_order - specify authentication order
* sasl_mechanisms, sasl_user, sasl_password - for SASL authentication
* tls_cipher_suite, tls_ca_certificate_path, tls_ca_revocation_path,
tls_ca_peer_verify_chain_path, tls_certificate_file,
tls_certificate_chain_file, tls_key_file, tls_allow_no_crl,
tls_key_update, tls_build_chain_local, tls_proxy_certificate,
tls_security_level - for TLS secure communication
Documentation
* SASL authentication and secure communication with TLS
Updated feature
* gfpcopy - -t option for parallel copy of large files. Default is 2.
* gfpcopy - -T option to specify the threshold for large files.
Default is 1G.
* gfuser - -A option to specify a global name for each authentication
method
* gfuser - -L option to display more user information
* gfstatus - -S option to display static settings
Release note for Gfarm 2.7.25
=============================
[2023.7.14]
Updated feature
* gfptar - distribute target tar files
* gfptar - support files as members
* gfptar - can be interrupted
* gfptar - display more detailed progress messages
Bug fix
* gfptar - do not leave a destination directory when an error occurs
* gfmd - fix data race when a slave is promoted to a master
Release note for Gfarm 2.7.24
=============================
[2023.6.24]
Updated feature
* gfmd - warn when no file system node
* gfptar - print more detailed progress messages
* gfkey - gfarm2.conf is not mandatory
* config-gfarm - introduce gfmd-slave.service to execute gfmd in slave
mode
Bug fix
* gfptar - fix unexpected output filenames
* gfptar - fix possible no information of the directory
* gfptar - fix too many open files
* gfptar - fix possible broken pipe
* config-gfarm - fix DEBUG=true does not work
* unconfig-gfarm.sh - do not abort when backend database is already
stopped
Release note for Gfarm 2.7.23
=============================
[2023.4.30]
Updated feature
* gfpcopy, gfptar - ensure durability upon successful completion
* gfsd - ensure durability upon successful replication
Release note for Gfarm 2.7.22
=============================
[2023.3.29]
Updated feature
* gfsd - more logs to investigate data corruption during network
transmission
Bug fix
* gfsd - fix error messages at source node during replication,
introduced in the version 2.7.21
Release note for Gfarm 2.7.21
=============================
[2023.3.14]
New command
* gfptar - parallel tar command
Updated feature
* gfpcopy - select from all available hosts if all hosts in
write_target_domain are readonly
* config-gfarm - support PostgreSQL 14 or later
* config-gfarm - sanity check for metadata admin user
Bug fix
* gfhost - fix segfault when executing gfhost -H host
* config-gfarm, config-gfsd - fix DEBUG=true does not work
* gfmd - fix race condition in metadata server management
* gfmd - fix error message in replication [#1137]
Release note for Gfarm 2.7.20
=============================
[2022.3.24]
Updated feature
* support ARM platform
* gfpcopy - select from all available hosts if no host available in
write_target_domain
Release note for Gfarm 2.7.19
=============================
[2021.6.2]
Bug fix
* gfpcopy - fix segfault when overwriting a symlink with a regular file
[#1120]
Release note for Gfarm 2.7.18
=============================
[2021.4.23]
New configuration directive
* network_send_timeout - timeout to send data. Default is 0 that
means no timeout
Updated feature
* gfprep - -m option works even when the destination already stores
the file replica [#1111]
* gfsetfacl and gfgetfacl - -R option to recursively change ACLs
[#1107]
* gfmd - improves startup time
Bug fix
* gfarm2fs fails due to race condition to connect gfmd, introduced by
the version 2.7.17
* gfprep - -M option may exit before the limit [#1112]
* gfmd may crash when a parent directory has default ACL [#1108]
Release note for Gfarm 2.7.17
=============================
[2020.9.17]
Update note
* this release requires config-gfarm-update --update
New feature
* libgfarm - Multithread safe. For details, see
lib/libgfarm/README.MT-safe
* Gfarm read only file system - gfstatus -Mm 'read_only enable'
* pkg-config support
New configuration file
* gfmd.failover.conf - this configuration file will be read at
failover, which is mainly used by Gfarm-zabbix failover mechanism to
make Gfarm read only when gfmd is failed over but it may be stale.
This file is created by config-gfarm or config-gfarm-update --update.
New configuration directive
* read_only - read only file system
* spool_server_read_only_interval - if there are files still opened
and modified when Gfarm is changed to a read only file system, these
files cannot be closed until Gfarm is changed to a read-write file
system. This directive specifies the interval in second for gfsd to
check the status change.
* include - includes a configuration file
* include_nesting_limit - limits the nesting level of include files
* failover_notify_delay - delay to notify failover to gfsd servers
Documentation
* document for Gfarm encrypted file system using EncFS
Updated feature
* gfarmbb - -mpi and -conf options to set up Gfarm/BB using mpirun
* gfmv - allow gfmv between different directory quota setting [#1081]
* gfkey - -V option to display version information
* gfstatus - auth directive can be dynamically updated
* config-gfarm-update - error check
* gfsd - display gfsd type in command line field of ps(1) [#1100]
* gfmd - record gfmd config changes in log [#1097]
* gfmd - -u option to specify file name of gfmd.failover.conf
* gfmd - automatic quota check again, which makes gfquotacheck
unnecessary
* libgfarm - support GFARM_FILE_UNBUFFERED in open flag
* FTBFS on GNU Hurd [#805]
Bug fix
* removing user may crash gfmd at restart when using directory quota
[#1102]
* fix segfault when calling gfarm_initialize after gfarm_terminate if
log_file directive is used
* when gfmd is failovered, quota is not correct [#1101]
Release note for Gfarm 2.7.16
=============================
[2019.11.30]
Updated feature
* reduce logs when files on a readonly gfsd are removed
Release note for Gfarm 2.7.15
=============================
[2019.10.24]
New configuration directive
* rdma_gid_index - specify the gid index to use GRH
Updated feature
* gfarmbb - status command to check process, network and directory
status for Gfarm/BB
Bug fix
* Remote write may fail due to completion error when using InfiniBand
Release note for Gfarm 2.7.14
=============================
[2019.9.10]
New command
* gfarmbb - start and stop scripts for Gfarm/BB node-local on-demand
file system
New configuration directive
* log_file - specify a log file
* quota_check_retry_interval, directory_quota_check_retry_interval -
specifies the interval to re-calculate the quota. This is
introduced to make replica check progress. Default is 60 seconds.
* schedule_rpc_timeout - specifies the timeout for RPC.
Updated feature
* gfmd, gfsd - -F option to specify a log file
Bug fix
* gfquotacheck - may fail due to timeout
* libgfarm - too high CPU load may cause gfsd protocol mismatch
* gfsd - fix race condition to terminate that may fail to record the
write verify information
Release note for Gfarm 2.7.13
=============================
[2019.3.22]
New configuration directive
* replication_at_write_open - if this directive is enabled, even when
all file replicas of a file are stored at read-only filesystem
nodes, it can be updated by replicating it to a read-write
filesystem node before opening in the write mode. Default is
enable.
Updated feature
* read-only mode - filesystem node can be changed to read only by
gfhost -m -f 1 hostname
* gfdf - -R option to know real disk usage
Bug fix
* gfmd failover does not work, which was introduced by the version
2.7.12
* compilation error with InfiniBand, which was introduced by the
version 2.7.12
* gfquota -d does not work against a writable directory
Release note for Gfarm 2.7.12
=============================
[2019.2.20]
Documentation
* failover and disaster recovery documents
Updated feature
* gfmd - improve replica check process especially using replicainfo
that means file system group based replica location control feature
* gfstatus - -l and -L options to list configuration names
* support 8 Exbibyte file system node
Bug fix
* gfdf - fix output with -a option
Release note for Gfarm 2.7.11
=============================
[2018.6.25]
Updated feature
* change default of gfsd_connection_cache from 16 to 256.
* adjust log level
Release note for Gfarm 2.7.10
=============================
[2018.2.22]
Updated feature
* gfmd - improve ticket lock performance, which is introduced since
the version 2.7.9
Bug fix
* directory quota may be incorrect when moving a file during the
replica check
* slave gfmd may crash when it is stopped during busy metadata updates
* gfmd crashes when it is stopped at early boot stage
Release note for Gfarm 2.7.9
============================
[2018.1.16]
Updated feature
* gfmd - improve response time during replica check when enabling
replica info. By default, use a ticket lock for FIFO thread
scheduling instead of a stock mutex lock.
Bug fix
* replica check does not honor directory quota
* fix deadlock or segfault when reading files using InfiniBand RDMA if
reconnection happens
Release note for Gfarm 2.7.8
============================
[2017.12.03]
Updated feature
* show the number of ongoing replications by SIGUSR2
Bug fix
* spool_check_level disable makes gfsd unstable, which has been
introduced since the version 2.7.6
* fix data race when switching gfsd or gfmd connections, that may make
segfault
* fix data race about gfsd status
Release note for Gfarm 2.7.7
============================
[2017.11.26]
New configuration directive
* metadb_server_remove_scan_log_interval - interval to log statistical
information about removed file scan
* metadb_server_remove_scan_interval_factor - interval between removed
file scans
Documentation
* manual pages - gfrepcheck(1)
Updated feature
* gfmd - improve response time even under too many gfmd-initiated
replications, file removals and updates
* gfdf - -i option to print number of inodes
* gfrepcheck - status command to obtain the current status
Release note for Gfarm 2.7.6
============================
[2017.10.1]
New configuration directive
* replication_busy_host - specify whether destinations of
gfmd-initiated replication include busy hosts or not. Default is
enable. Note that file replica creation to busy file system nodes
is disabled since 2.7.2. To keep this behavior, specify
replication_busy_host disable
* replica_check_remove_grace_used_space_ratio,
replica_check_remove_grace_time - specify grace space ratio and
grace time for replica check remove
* spool_check_parallel, spool_check_parallel_max,
spool_check_parallel_per_capacity, spool_check_parallel_step -
specifies the number of parallelism and granularity of spool check
Updated feature
* gfsd - parallel spool check for faster spool check processing
* gfmd - gfmd-initiated replication selects a file replica to be
replicated randomly to avoid concentration
* gfmd - more rigit disk available check to avoid no space error
* gfrepcheck - gfrepcheck stop stops replica check processing
soon.
Release note for Gfarm 2.7.5
============================
[2017.8.9]
New configuration directive
* max_directory_depth - maximum directory depth. Default is 100.
Release note for Gfarm 2.7.4
============================
[2017.7.14]
New configuration directive
* directory_quota_check_start_delay - delay to start directory quota
check to aggregate multiple checks
Updated feature
* gfrm - do not try to remove symlinks with the -h option
* gfmd - more log in peer_set_host
* postgresql backend - accept IPv6 connection, which is required in
CentOS 7.3.1611
Bug fix
* gfmd - invalid replica cannot be moved to lost+found, which is
introduced by the version 2.7.0
* recursive option does not return error properly
* compilation error on FreeBSD-10.2/amd64
* gfsd - invalid file remains when fhclose fails
* gfmd does not recover from the warning of abandon invalid journal
* gfmd - gfmd may fail to restart when using the none backend
Release note for Gfarm 2.7.3
============================
[2017.3.26]
Updated feature
* gfprep, gfpcopy - a new scheduling to mitigate destination conflict
under concurrent gfprep and gfpcopy executions
* start replica check when a busy host becomes idle
New configuration directive
* metadb_server_remover_queue_length - queue length for remove
requests to make it a low priority not to prevent from replication
requests
Bug fix
* gfmd may not respond when sending journal logs to async slaves
* write only files may not be moved to lost+found
* Gfarm RPM packages cannot be installed on RHEL7 or CentOS7
Release note for Gfarm 2.7.2
============================
[2017.2.4]
New configuration directive
* replicainfo - disables file system group based replica location
control feature. Only number of file replicas is maintained. This
directive is available for gfmd
Updated feature
* gfmd - support none backend database for temporal Gfarm file system
without any backend database. Journaling keeps metadata change log
up to the journal file size
* gfmd - do not create file replicas in busy file system nodes
Release note for Gfarm 2.7.1
============================
[2017.1.14]
Updated feature
* gfpcopy, gfprep - do not copy to busy hosts by default. This will
be disabled by -B option
* gfpcopy, gfprep - -I option to specify interval to collect host
information. Default is 300 seconds.
* gfsd - adjust log level for non-critical replication failure
Bug fix
* incorrect metadb_server_list causes assertion failure
Release note for Gfarm 2.7.0
============================
[2016.12.8]
New feature
* InfiniBand RDMA support
* Directory quota (see doc/html/en/user/dirquota.html for details)
New command
* gfdirquota - manage directory set for directory quota
New configuration directive
* ib_rdma - enables or disables InfiniBand RDMA data transfer. When
configuring --with-infiniband, default is enable.
* rdma_device_name, rdma_port - optional directive to specify device
name and port number, respectively, for RDMA data transfer
* rdma_min_size - minimum size for RDMA data transfer. Default is
65536 bytes
* rdma_mr_reg_mode - specifies memory registration mode. Default is
static.
* rdma_mr_reg_static_min_size, rdma_mr_reg_static_max_size - minimum
and maximum size for static RDMA buffer for each gfsd connection.
Default is 1MiB and 16MiB, respectively
* directory_quota_count_per_user_limit - maximum number of directory
sets for each user. Default is 100
Updated feature
* gfedquota, gfquota - -D and -d options for directory quota
Release note for Gfarm 2.6.15
=============================
[2016.12.3]
Updated feature
* OpenSSL 1.1.0 support
* gfprep - -mm option to keep an original copy in migration mode
* gfsd - log message of write_verify process includes the hostname
Bug fix
* gfprep -m may fail due to file busy even though all operations succeed
Release note for Gfarm 2.6.14
=============================
[2016.10.26]
New command
* gflsof - list current opened Gfarm files
Updated feature
* increase default timeout to connect to gfmd to 35 seconds to cope
with fault of primary and secondary DNS servers
Release note for Gfarm 2.6.13
=============================
[2016.9.27]
New configuration directive
* max_open_files - specify the maximum number of open files. Default
is 1024.
Updated feature
* gfmd - keep minimum disk space to reduce no space risk
Release note for Gfarm 2.6.12
=============================
[2016.8.16]
New feature
* symbolic link support for master-slave redundant metadata servers -
metadb_server_list directive can be used several times to specify
several metadata server groups
Updated feature
* iostat - new data format that aligns the cache line to avoid
unnecessary false sharing. This requires ganglia plugin update by
config-{gfsd,gfmd}-iostat -f
Bug fix
* fix compilation error on Linux/alpha. This patch is contributed by
Michael Cree via Dmitry Smirnov [https://bugs.debian.org/827021]
* gfpcopy - plug memory leak, which was introduced in Gfarm 2.6.6
* gfmd - quota is not effective just after gfmd start-up or failover
* gfmd - incorrect grace period for soft quota after gfmd restart or
failover
* gfsd - may give up to reconnect to gfmd
* gfsd - incorrect period for write_verify is reported at gfsd crash
on Linux 2.6.22 or before
Release note for Gfarm 2.6.11
=============================
[2016.6.2]
Bug fix
* gfpcopy does not tolerate file migration or file replica removal
* gfs_pio_close() returns GFARM_ERR_BAD_FILE_DESCRIPTOR when it is
called against a never accessed 0-byte file
* gfmd may deadlock in GSI when using Globus Toolkit 6.0 or later
* multi spool directories - directories having the same prefix cannot
be specified
Release note for Gfarm 2.6.10
=============================
[2016.4.25]
New configuration directive
* metadb_server_nfs_root_squash_support - disables nfs root squash
support to improve the metadata performance if it is not necessary
* write_verify_log_interval - specifies the interval to record
statistics of write verify
Updated feature
* profile and progress logging support for write verify
Bug fix
* when gfmd is down, gfsd may not log failed close operation at exit
* multiple spool directories may cause inconsistent file creation. If
this happens, alert and move it to the spool top directory.
Release note for Gfarm 2.6.9
============================
[2016.4.3]
New configuration directive
* spool_server_back_channel_rcvbuf_limit and
metadb_server_back_channel_sndbuf_limit - limits outstanding
requests between gfsd and gfmd to reduce risk of the disconnection.
Default is 4096 bytes.
Updated feature
* gfsd - support multiple spool directories
* most available disk space is selected when creating files
* gfwhere - -m option to select files having the specified number or
less number of replicas
* gfwhere - -h option to select files that stored on the specified
host
* gfstatus - -m option to change the configuration parameter in gfmd
with -M option. Currently, 'digest', 'write_verify',
'write_verify_interval', 'write_verify_retry_interval' can be
changed. Note that write_verify is enabled only after gfsd is
restarted.
* write_verify process of gfsd terminates and dumps file information
to be verified by TERM signal
* gfspoolpath - -I option to specify inode number and generation
number instead of a filename
Bug fix
* updated files during the connection between gfsd and gfmd is
disconnected cannot be accessed
* master gfmd may crash when connecting from an expired slave gfmd
[sf.net ticket #947]
* delete metadata when a copy cannot be created due to no space error
* mtime of gfs_pio_stat() and gfs_stat() is inconsistent, which may
cause failure to extract symbolic links from tar files
Release note for Gfarm 2.6.8
============================
[2016.1.16]
New feature
* write verify - detect silent data corruption by re-reading files
New configuration directive
* write_verify - enables the write verify feature
* write_verify_interval - specifies the wait time in seconds of the
write verify after the file creation. Default is 21600 seconds (6
hours).
* write_verify_retry_interval - specifies the wait time in seconds to
retry write verify when the file is opened for writing at the write
verify time. Default is 600 seconds (10 minutes).
Updated feature
* gfstatus - -M option to ask configuration, e.g. write_verify or
digest, in gfmd
* gfmd reports file names opened for writing when gfsd exits without
closing them
* quota check for file replication, chown, and chgrp
Bug fix
* gfmd crashes when quota prevents file creation [sf.net ticket #936]
* gfsd - plug memory leak at gfmd-initiated replication, which was
introduced by Gfarm 2.6.0
Release note for Gfarm 2.6.7
============================
[2015.11.28]
Updated feature
* make gfarm2fs return EIO instead of EINVAL, when no replica is
available [sf.net ticket #924]
Bug fix
* gfrep and gfprep may create incomplete replica when network error
happens, which is introduced by Gfarm 2.6.0 [sf.net ticket #926]
* local host is not selected when reading a file at first operation,
which was introduced by Gfarm 2.6.0
* When a file system node crashes during receiving a file replica, the
metadata remains [sf.net ticket #913]
* client_digest_check does not return an error even when checksum
mismatch happens [sf.net ticket #915, #916]
* gfarm clients may access uninitialized data, and may dump core, if
$HOME/.gfarm2rc does not exist [sf.net ticket #912]
* changing gfmd port number by "gfmdhost -m -p" makes gfmd crash
[sf.net ticket #918]
* When trying to modify a file stored at a file server with no space
or in read-only mode, return no space immediately instead of
retrying for a while
Release note for Gfarm 2.6.6
============================
[2015.8.29]
New configuration directive
* client_parallel_max - the maximum number of parallel operations that
can be specified by gfpcopy and gfprep
Documentation
* manual pages - gfs_pio_sendfile(3), gfs_pio_recvfile(3)
* manual pages - gfarm_environ(7) that describes environment variables
for Gfarm including ciphers in GSI communication
* user manual - cipher-comparison.html that describes the performance
of each cipher in typical architectures
Updated feature
* gfpcopy, gfprep - -k option not to copy symlinks [sf.net ticket
#904]
* gfpcopy, gfprep - -X option to exclude files or directories [sf.net
ticket #901]
* gfpcopy, gfprep - retry if copy or replication fails [sf.net ticket
#903]
* gfmv - more like mv(1) not just calling gfs_rename(2) [sf.net ticket
#897]
* automatic quota check - gfquotacheck is not needed to be called
explicitly [sf.net ticket #902]
* gfcksum - -l option to show a long path for each file [sf.net ticket
#879]
* adjust log level [sf.net ticket #876, #877]
* gfjournal - performance improvement [sf.net ticket #872]
* automatic repair at replication when the file is corrupted [sf.net
ticket #836]
* gfjournaldump - support ruby 1.9 or later
Bug fix
* gfjournal - fix incorrect output for offset [sf.net ticket #878]
* gfjournaldump - fix incorrect output [sf.net ticket #870]
* gfmd may crash when gfedquota is executed after gfmd failover
[sf.net ticket #906]
Release note for Gfarm 2.6.5.1
==============================
[2015.7.5]
Bug fix
* initialization for thread-safe OpenSSL is not called at the
beginning
* when specifying the same entry for rename, the entry is unlinked
[sf.net ticket #450]
* gfrmdir / returns 'is a directory' [sf.net ticket #451]
* file system node is not removed in the backend database when it has
no file replica, which was introduced by Gfarm 2.6.5 [sf.net ticket
#868]
* replica check does not start when the file system node group is
changed [sf.net ticket #866]
* replica check does not start when gfarm.replicainfo is removed
[sf.net ticket #867]
Release note for Gfarm 2.6.5
============================
[2015.6.25]
New feature
* automatic removal of excessive number of file replicas
* gfrepcheck - remove and reduce_log commands to control automatic
replica removal and log summary output features
* gfpcopy - HPSS support
* gfprep, gfpcopy - -z and -Z options to specify the minimum and
maximum file size to copy, respectively
New configuration directive
* replica_check_remove - disables automatic replica removal feature
* replica_check_reduced_log - disables log summary output feature in
replica check
* metadb_replica_remover_by_host_sleep_time
* metadb_replica_remover_by_host_inode_step
Updated feature
* file replicas can be removed only when available number of replicas
is greater than required [sf.net ticket #857]
* gfexport - accept multiple input files [sf.net ticket #853]
* gfspooldigest - show statistics at the end
* libgfarm - do not connect to servers when client certificate is
expired
* gfhost -d removes file replicas stored on the deleted host [sf.net
ticket #860]
* gfjournal -m - performance improvement
* gfmd - SIGHUP is not needed to reload CA certificate and CRL
* slave gfmd - do not exit when journal receive queue overflows
Bug fix
* gfmd may crash in GSI [sf.net ticket #854]
* gfmd - replica check does not create required replicas when gfsd is
up [sf.net ticket #856]
* client may block when GSI authentication fails
* client may crash when connection problem happens [sf.net ticket
#852]
* slave gfmd may exit when connection problem happens [sf.net ticket
#851]
* gfmkdir - fix invalid memory reference in error case
Release note for Gfarm 2.6.4.1
==============================
[2015.4.30]
Updated feature
* gfspooldigest - -M option to select files modified older than the
specified days ago
* make progress of replica check
Bug fix
* gfspooldigest - segfault when gfmd failover happens [sf.net ticket
#848]
Release note for Gfarm 2.6.4
============================
[2015.4.26]
Updated feature
* gfpcopy - overwrite files when having no file replica
* gfspooldigest (aka gfspoolmd5) - -G option to read files in a spool
directory in Gfarm API, which is useful to move corrupted files to
lost+found
* gffilepath - -l and -P options to specify the metadata directory and
the backend database path, respectively
* master gfmd stops after all journal transfer for safe failover to an
asynchronous slave server [sf.net ticket #845]
* adjust log level
Bug fix
* cannot build on Mac OS X and NetBSD since Gfarm 2.6.1 [sf.net ticket
#846]
* gffilepath - it does not support hardlinked files
Release note for Gfarm 2.6.3
============================
[2015.4.13]
Bug fix
* gfs_pio_sendfile/recvfile may generate incorrect digest
* when a slave gfmd is changed from asynchronous to synchronous, it
stops to work [sf.net ticket #829]
Release note for Gfarm 2.6.2
============================
[2015.3.27]
Updated feature
* unconfig scripts are generated by config-gfarm and config-gfsd to
undo the configuration process [sf.net ticket #819]
Bug fix
* mtime becomes Jan 1, 1970 when client_digest_check is enabled, which
was introduced by Gfarm 2.6.1 [sf.net ticket #832]
* missing checksum check during automatic replication when a file is
created [sf.net ticket #835]
* fix lost update problem that happens concurrent read and write cases
* gfreg - leaves an empty file incorrectly when a diskfull host is
specified by -h option [sf.net ticket #842]
* config-gfarm, config-gfsd - fix permission of configuration file of
systemd [sf.net ticket #830]
* fix infinite loop of replica check due to file size or checksum
mismatch
Release note for Gfarm 2.6.1
============================
[2015.3.2]