{"id":12592,"date":"2016-12-04T09:00:21","date_gmt":"2016-12-04T00:00:21","guid":{"rendered":"http:\/\/www.techscore.com\/blog\/?p=12592"},"modified":"2018-11-14T16:33:44","modified_gmt":"2018-11-14T07:33:44","slug":"veryfy-write-buffer-4kb-8kb","status":"publish","type":"post","link":"https:\/\/www.techscore.com\/blog\/2016\/12\/04\/veryfy-write-buffer-4kb-8kb\/","title":{"rendered":"\u66f8\u304d\u8fbc\u307f\u30d0\u30c3\u30d5\u30a14KB, 8KB\u3092\u691c\u8a3c\u3057\u3066\u307f\u308b"},"content":{"rendered":"
\u3053\u306e\u8a18\u4e8b\u306f TECHSCORE Advent Calendar 2016<\/a> \u306e 4 \u65e5\u76ee\u306e\u8a18\u4e8b\u3067\u3059\u3002<\/p>\n \u30b7\u30b9\u30c6\u30e0\u306e\u904b\u7528\u30fb\u69cb\u7bc9\u30fb\u5b9f\u88c5\u306a\u3069\u3067\u3001\u30c7\u30a3\u30b9\u30af\u3078\u306e\u66f8\u304d\u8fbc\u307f\u30d0\u30c3\u30d5\u30a1\u30924KB\/8KB\u306b\u3059\u308b\u3053\u3068\u3063\u3066\u591a\u3044\u3067\u3059\u3088\u306d\uff1f\u3000\u4f8b\u3048\u3070\u5f0a\u793e\u3067\u3088\u304f\u5229\u7528\u3057\u3066\u3044\u308bDBMS\u3067\u3042\u308b \u300cPostgreSQL\u300d\u306f\u3001\u30c7\u30a3\u30b9\u30af\u3078\u306e\u66f8\u304d\u8fbc\u307f\u306f8KB\u5358\u4f4d\u3067\u884c\u308f\u308c\u307e\u3059\u3057\u3001\u624b\u5143\u306eJava\u3067OutputStreamWriter\u3092\u78ba\u8a8d\u3057\u3066\u307f\u308b\u30688KB\u3067\u30d0\u30c3\u30d5\u30a1\u30ea\u30f3\u30b0\u3055\u308c\u3066\u3044\u308b\u3088\u3046\u3067\u3057\u305f\u3002<\/p>\n \u306a\u305c\u3053\u306e\u30b5\u30a4\u30ba\u306a\u306e\u3067\u3057\u3087\u3046\uff1f\uff1f\u3000\u6c17\u306b\u306a\u308a\u307e\u3059\u306d\u3002\u9069\u5f53\u306b\u5927\u304d\u3081\u306e\u30b5\u30a4\u30ba\u30013KB\u3068\u304b5KB\u3067\u306f\u30c0\u30e1\u306a\u3093\u3067\u3057\u3087\u3046\u304b\uff1f<\/p>\n \u30c7\u30a3\u30b9\u30af\u3078\u306er\/w\u8981\u6c42\u306f\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u306e\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u5358\u4f4d\u3067\u884c\u308f\u308c\u308b\u306e\u3067\u3001\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u3068\u304b\u3089\u3081\u3064\u3064\u691c\u8a3c\u3057\u3066\u307f\u307e\u3059\uff01<\/p>\n \u5358\u7d14\u306b\/mnt\/test\/test.dat\u306b128MB\u3092\u30b7\u30fc\u30b1\u30f3\u30b7\u30e3\u30eb\u30e9\u30a4\u30c8\u3059\u308b\u30d7\u30ed\u30b0\u30e9\u30e0\u3067\u3059\u3002dataSize\u30922048, 4096, 6144, 8192\u3068\u5909\u66f4\u3057\u306a\u304c\u3089\u66f8\u304d\u8fbc\u307f\u306b\u304b\u304b\u3063\u305f\u6642\u9593\u3092\u8a08\u6e2c\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n mkfs.ext4 \u2013b 4096 \u3067\u30d5\u30a9\u30fc\u30de\u30c3\u30c8\u3057\u3066\u691c\u8a3c\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n \u30c6\u30b9\u30c8\u30d7\u30ed\u30b0\u30e9\u30e0\u5b9f\u884c\u524d\u306b\u3001\u6bce\u56de\u4e0b\u8a18\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u3066\u3001\u65b0\u898f\u30d5\u30a1\u30a4\u30eb(\u8ffd\u8a18)\u3068\u3057\u3066\u30c6\u30b9\u30c8\u3057\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002 \u30d0\u30c3\u30d5\u30a1\u30b5\u30a4\u30ba\u304c\u5927\u304d\u3044\u65b9\u304c\u82e5\u5e72\u901f\u3044\u3067\u3059\u306d\u3002<\/p>\n \u6b21\u306f\u4e0a\u66f8\u304d\u306e\u30c6\u30b9\u30c8\u3067\u3059\u3002\u4e0a\u66f8\u304d\u306a\u306e\u3067\u30d5\u30a1\u30a4\u30eb\u306f\u524a\u9664\u305b\u305a\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u3060\u3051\u6d88\u3057\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002<\/p>\n \u3053\u308c\u306f\u9762\u767d\u3044\u7d50\u679c\u306b\u306a\u308a\u307e\u3057\u305f\u3002\u30d0\u30c3\u30d5\u30a1\u30b5\u30a4\u30ba2048,6144\u306e\u7d50\u679c\u304c\u6975\u7aef\u306b\u60aa\u3044\u3067\u3059\u3002<\/p>\n \u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u306b\u30d5\u30a1\u30a4\u30eb\u306e\u5185\u5bb9\u304c\u306e\u3063\u3066\u3044\u308b\u72b6\u614b\u3067\u306e\u4e0a\u66f8\u304d\u306f\u3069\u3046\u306a\u308b\u304b\uff1f\u3000\u30c6\u30b9\u30c8\u3057\u3066\u3044\u308b\u30de\u30b7\u30f3\u306f\u30e1\u30e2\u30ea\u306b\u4f59\u88d5\u304c\u3042\u308b\u306e\u3067\u3001128MB\u307b\u3069\u3067\u3042\u308c\u3070\u3059\u3079\u3066\u30ad\u30e3\u30c3\u30b7\u30e5\u306b\u306e\u308a\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002<\/p>\n \u901f\u3044\u3067\u3059\u306d\uff01\u3000\u5168\u4f53\u7684\u306b\u8ffd\u8a18\u306e\u5834\u5408\u3068\u50be\u5411\u304c\u4f3c\u3066\u3044\u3066\u3001\u82e5\u5e72\u8ffd\u8a18\u3088\u308a\u3082\u901f\u3044\u3067\u3059\u3002<\/p>\n \u3067\u306f\u6b21\u306b\u3001\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u306e\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u30922KB\u306b\u5909\u66f4\u3057\u3066\u540c\u3058\u30c6\u30b9\u30c8\u3092\u884c\u3063\u3066\u307f\u307e\u3057\u3087\u3046\u3002<\/p>\n mkfs.ext4 \u2013b 2048 \u3067\u30d5\u30a9\u30fc\u30de\u30c3\u30c8\u3057\u3066\u691c\u8a3c\u3057\u3066\u307f\u307e\u3059\u3002<\/p>\n \u5148\u307b\u3069\u3068\u540c\u3058\u3088\u3046\u306b\u6bce\u56de\u30c6\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u524a\u9664\u3057\u3066\u5b9f\u884c\u3057\u3066\u3044\u304d\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002<\/p>\n mkfs.ext4 \u2013b 4096 \u3068\u3042\u307e\u308a\u7d50\u679c\u304c\u5909\u308f\u3089\u306a\u3044\u3067\u3059\u306d\u3002\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u306e\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u306f\u3042\u307e\u308a\u95a2\u4fc2\u306a\u3044\u306e\u3067\u3057\u3087\u3046\u304b\uff1f\uff1f<\/p>\n \u4e0a\u66f8\u304d\u306e\u30c6\u30b9\u30c8\u306f\u3069\u3046\u306a\u308b\u304b\uff1f\u3000\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u306a\u3057\u3067\u30c6\u30b9\u30c8\u3057\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002<\/p>\n \u3053\u308c\u3082\u9762\u767d\u3044\u7d50\u679c\u306b\u306a\u308a\u307e\u3057\u305f\u3002\u30d0\u30c3\u30d5\u30a1\u30b5\u30a4\u30ba2048, 6144\u306e\u7d50\u679c\u304cmkfs.ext4 \u2013b 4096\u3068\u306f\u6bb5\u9055\u3044\u306b\u901f\u3044\u3067\u3059\uff01<\/p>\n \u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u3042\u308a\u306e\u5834\u5408\u3082\u30c6\u30b9\u30c8\u3057\u307e\u3059\u3002<\/p>\n dataSize\u30922048, 4096, 6144, 8192\u3068\u3057\u305f\u305d\u308c\u305e\u308c\u306e\u5b9f\u884c\u7d50\u679c\u3067\u3059\u3002<\/p>\n mkfs.ext4 \u2013b 4096\u306e\u5834\u5408\u3068\u4f3c\u305f\u50be\u5411\u3067\u3059\u306d\u3002\u82e5\u5e72\u3053\u3061\u3089\u306e\u65b9\u304c\u9045\u3044\u3067\u3059\u3002<\/p>\n Linux\u3067\u306eI\/O\u51e6\u7406\u306f\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u304c\u5b58\u5728\u3059\u308b\u304b\u3057\u306a\u3044\u304b\u304c\u5927\u304d\u304f\u95a2\u308f\u308a\u307e\u3059\u3002\u901a\u5e38\u306e\u66f8\u304d\u8fbc\u307f\u51e6\u7406\u306f\u3001\u5e38\u306b\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u306b\u5bfe\u3057\u3066\u884c\u308f\u308c\u307e\u3059\u3002\u307e\u305f\u3001\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u306f\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u5358\u4f4d\u3067I\/O\u51e6\u7406\u3092\u884c\u3044\u307e\u3059\u3002<\/p>\n \u4e0a\u66f8\u304d\u51e6\u7406\u304c\u3069\u306e\u3088\u3046\u306b\u884c\u308f\u308c\u308b\u304b\u3001\u8003\u3048\u3066\u307f\u307e\u3057\u3087\u3046\u3002<\/p>\n \u4e0a\u66f8\u304d\u51e6\u7406\u306f\u30c7\u30fc\u30bf\u306e\u5909\u66f4\u51e6\u7406\u3067\u3059\u304b\u3089\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u306b\u5909\u66f4\u7b87\u6240\u306e\u30d6\u30ed\u30c3\u30af\u304c\u8aad\u307f\u8fbc\u307e\u308c\u3066\u3044\u306a\u3044\u5834\u5408\u3001\u307e\u305a\u5148\u306b\u30c7\u30a3\u30b9\u30af\u304b\u3089\u8aad\u307f\u8fbc\u307e\u306a\u3051\u308c\u3070\u306a\u308a\u307e\u305b\u3093\u3002\u8aad\u307f\u8fbc\u307f\u5f8c\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u4e0a\u3067\u5909\u66f4\u3092\u66f8\u304d\u8fbc\u307f\u307e\u3059\u3002\u306a\u306e\u3067\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u306e\u30a2\u30ea\u30fb\u30ca\u30b7\u3067\u5287\u7684\u306b\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\u304c\u5909\u308f\u308a\u307e\u3059\u3002<\/p>\n \u3057\u304b\u3057\u3001\u3053\u308c\u306b\u306f\u4f8b\u5916\u304c\u3042\u308a\u307e\u3059\u3002\u5909\u66f4\u7b87\u6240\u306e\u30d6\u30ed\u30c3\u30af\u3059\u3079\u3066\u3092\u66f8\u304d\u63db\u3048\u308b\u5834\u5408\u3001\u30c7\u30fc\u30bf\u306e\u8aad\u307f\u8fbc\u307f\u304c\u5fc5\u8981\u306a\u3044\u305f\u3081\u3001\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u5185\u3067\u51e6\u7406\u304c\u5b8c\u7d50\u3057\u307e\u3059\u3002<\/p>\n \u691c\u8a3c\u3067\u306f\u30014KB\u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba\u3067\u306e2KB, 6KB\u306e\u66f8\u304d\u8fbc\u307f\u51e6\u7406\u304c\u969b\u7acb\u3063\u3066\u9045\u304b\u3063\u305f\u3067\u3059\u306d\u3002\u3053\u308c\u306f\u4f8b\uff11\u306e\u30b1\u30fc\u30b9\u304c\u3042\u3066\u306f\u307e\u308a\u307e\u3059\u3002\u66f8\u304d\u8fbc\u307f\u51e6\u7406\u306e\u3064\u3082\u308a\u304c\u3001\u5b9f\u306f\u8aad\u307f\u8fbc\u307f\u51e6\u7406\u304c\u5148\u306b\u5b9f\u884c\u3055\u308c\u3066\u3044\u308b\u3068\u3044\u3046\u72b6\u6cc1\u3067\u3059\u3002\u8aad\u307f\u8fbc\u307f\u306e\u9593\u3001\u30d7\u30ed\u30bb\u30b9\u306f\u5f85\u305f\u3055\u308c\u3001I\/O Wait\u306b\u8a08\u4e0a\u3055\u308c\u307e\u3059\u3002<\/p>\n \u8aad\u307f\u8fbc\u307f\u304c\u983b\u767a\u3059\u308b\u69d8\u5b50\u306f\u3001\u30c6\u30b9\u30c8\u30d7\u30ed\u30b0\u30e9\u30e0\u3092\u5b9f\u884c\u4e2d\u306bblktrace\u30b3\u30de\u30f3\u30c9\u3092\u4f7f\u7528\u3059\u308b\u3068\u3088\u304f\u308f\u304b\u308a\u307e\u3059\u3002<\/p>\nI. \u306f\u3058\u3081\u306b<\/h3>\n
II. \u30c6\u30b9\u30c8\u30d7\u30ed\u30b0\u30e9\u30e0<\/h3>\n
import java.io.RandomAccessFile;\r\n\r\npublic class WriteBench {\r\n\r\n public static void main(String[] args) throws Exception {\r\n String fileName = \"\/mnt\/test\/test.dat\";\r\n int fileSize = 1024 * 1024 * 128;\r\n int dataSize = 2048;\r\n\r\n WriteBench writeBench = new WriteBench();\r\n long execMillis = writeBench.bench(fileName, fileSize, dataSize);\r\n System.out.println(execMillis + \"msec\");\r\n }\r\n\r\n private long bench(String fileName, int fileSize, int dataSize) throws Exception {\r\n byte[] writeData = new byte[dataSize];\r\n long start = System.currentTimeMillis();\r\n try (RandomAccessFile f = new RandomAccessFile(fileName, \"rw\")) {\r\n for (int i = 0; i < fileSize \/ dataSize; i++) {\r\n f.write(writeData);\r\n }\r\n }\r\n return System.currentTimeMillis() - start;\r\n }\r\n}\r\n<\/pre>\n
III. ext4 \u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba4KB\u3067\u306e\u691c\u8a3c<\/h3>\n
A. \u8ffd\u8a18\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/h4>\n
$ rm \/mnt\/test\/test.dat<\/pre>\n
\n(\u7d50\u679c\u306f\u305d\u308c\u305e\u308c5\u56de\u5b9f\u884c\u3057\u3066\u5e73\u5747\u3092\u3068\u3063\u3066\u3044\u307e\u3059)<\/p>\n
\n4096 -> 104 msec
\n6144 -> 105 msec
\n8192 -> 83 msec<\/div>\nB. \u4e0a\u66f8\u304d\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/h4>\n
$ sync\r\n$ echo 1 > \/proc\/sys\/vm\/drop_caches\r\n<\/pre>\n
\n4096 -> 69 msec
\n6144 -> 1646 msec<\/strong>
\n8192 -> 59 msec<\/div>\nC. \u4e0a\u66f8\u304d\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\uff08\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u3042\u308a\uff09<\/h4>\n
$ free -m\r\n total used free shared buff\/cache available\r\nMem: 5685 1327 4137 8 219 4281\r\nSwap: 1023 0 1023\r\n<\/pre>\n
\n4096 -> 53 msec
\n6144 -> 51 msec
\n8192 -> 41 msec<\/div>\nIV. ext4 \u30d6\u30ed\u30c3\u30af\u30b5\u30a4\u30ba2KB\u3067\u306e\u691c\u8a3c<\/h3>\n
A. \u8ffd\u8a18\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/h4>\n
$ rm \/mnt\/test\/test.dat<\/pre>\n
\n4096 -> 117 msec
\n6144 -> 102 msec
\n8192 -> 93 msec<\/div>\nB. \u4e0a\u66f8\u304d\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9<\/h4>\n
$ sync\r\n$ echo 1 > \/proc\/sys\/vm\/drop_caches\r\n<\/pre>\n
\n4096 -> 75 msec
\n6144 -> 66 msec<\/strong>
\n8192 -> 55 msec<\/div>\nC. \u4e0a\u66f8\u304d\u3067\u306e\u30d1\u30d5\u30a9\u30fc\u30de\u30f3\u30b9\uff08\u30da\u30fc\u30b8\u30ad\u30e3\u30c3\u30b7\u30e5\u3042\u308a\uff09<\/h4>\n
\n4096 -> 75 msec
\n6144 -> 66 msec
\n8192 -> 57 msec<\/div>\nV. \u8003\u5bdf\u3057\u3066\u307f\u308b<\/h3>\n
\u25a0\u4f8b\uff11\u30004KB\u30d6\u30ed\u30c3\u30af\u306e\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30672KB\u4e0a\u66f8\u304d\u3092\u884c\u3046\u5834\u5408\u306e\u51e6\u7406\u30a4\u30e1\u30fc\u30b8<\/h4>\n
<\/a><\/p>\n
<\/a><\/p>\n
<\/a><\/p>\n
\u25a0\u4f8b\uff12\u30004KB\u30d6\u30ed\u30c3\u30af\u306e\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30674KB\u4e0a\u66f8\u304d\u3092\u884c\u3046\u5834\u5408\u306e\u51e6\u7406\u30a4\u30e1\u30fc\u30b8<\/h4>\n
<\/a><\/p>\n
<\/a><\/p>\n
<\/a><\/p>\n
\u25a04KB\u30d6\u30ed\u30c3\u30af\u306e\u30d5\u30a1\u30a4\u30eb\u30b7\u30b9\u30c6\u30e0\u30672KB\u66f8\u304d\u8fbc\u307f\u30c6\u30b9\u30c8\u4e2d\u306eI\/O\u30ea\u30af\u30a8\u30b9\u30c8<\/h4>\n
$ blktrace \u2013d \/dev\/sdb1 \u2013o - | blkparse \u2013<\/pre>\n