首页
学习
活动
专区
圈层
工具
发布
    • 综合排序
    • 最热优先
    • 最新优先
    时间不限
  • 来自专栏CU技术社区

    记1例MySQL 8.0.15版本Bug引起的风波

    最后经过查找官方文档,有这样一段描述: Storage Engine for On-Disk Internal Temporary TablesStarting with MySQL 8.0.16, the earlier, the internal_tmp_disk_storage_engine variable was used to define the storage engine used for on-disk internal_tmp_disk_storage_engine=MYISAM, an error occurs for any attempt to materialize a CTE using an on-disk MySQL 8.0.15 and earlier: When using internal_tmp_disk_storage_engine=INNODB, queries that generate on-disk The way MySQL uses on-disk internal temp tables (those produced during a query, not the explicit temporary

    1.7K10发布于 2020-05-01
  • 来自专栏Ceph对象存储方案

    小文件合并方案分享

    We call this file the on-disk log. The on-disk log is a pre-allocated file in a standard linux file system (ext4/xfs). In Ambry, we pre-allocate a file for each on-disk log. or blobs, the replicated store must maintain an index that maps blob IDs to specific offsets in the on-disk

    3.1K10发布于 2020-07-14
  • 来自专栏单细胞天地

    轻轻松松在R里面拿捏这130万单细胞的数据集

    sketch_analysis https://satijalab.org/seurat/articles/seurat5_bpcells_interaction_vignette 就是BPCells这个R包可以通过on-disk 27282 features, 0 variable features) ## 1 layer present: counts # Note that since the data is stored on-disk DefaultAssay(obj) <- "sketch" x1 <- FeaturePlot(obj, "C1qa") # switch to analyzing the full dataset (on-disk Note that the data remains on-disk after subsetting obj.sub <- subset(obj, subset = cluster_full %in% c(2, 15, 18, 28, 40)) DefaultAssay(obj.sub) <- "RNA" # now convert the RNA assay (previously on-disk

    1K10编辑于 2024-03-04
  • 来自专栏生信技能树

    轻轻松松在R里面拿捏这130万单细胞的数据集

    sketch_analysis https://satijalab.org/seurat/articles/seurat5_bpcells_interaction_vignette 就是BPCells这个R包可以通过on-disk 27282 features, 0 variable features) ## 1 layer present: counts # Note that since the data is stored on-disk DefaultAssay(obj) <- "sketch" x1 <- FeaturePlot(obj, "C1qa") # switch to analyzing the full dataset (on-disk Note that the data remains on-disk after subsetting obj.sub <- subset(obj, subset = cluster_full %in% c(2, 15, 18, 28, 40)) DefaultAssay(obj.sub) <- "RNA" # now convert the RNA assay (previously on-disk

    1.5K10编辑于 2024-01-05
  • 来自专栏后端云

    几个镜像清理初始化脚本

    Section 2 of 'log directories' loop:# Mount the tmpfs file system over the top of the existing on-disk Section 3 of 'log directories' loop:# Once the tmpfs file system has been mounted the original on-disk ${logd} # Create a mount point from which the contents of the original # on-disk Section 2 of 'Main' loop:# Mount the tmpfs file system over the top of the existing on-disk temp# Section 3 of 'Main' loop:# Once the tmpfs file system has been mounted the original on-disk temp#

    71030编辑于 2022-11-25
  • 来自专栏SEian.G学习记录

    MySQL临时表空间避坑指南

    the temporary tablespace data file is autoextending and increases in size as necessary to accommodate on-disk internal_tmp_disk_storage_engine variables, which define the storage engine to use for user-created and on-disk When an in-memory temporary table exceeds the limit, MySQL automatically converts it to an on-disk temporary The internal_tmp_disk_storage_engine option defines the storage engine used for on-disk temporary tables You can compare the number of internal on-disk temporary tables created to the total number of internal

    4.6K31编辑于 2022-03-30
  • 来自专栏腾讯数据库技术

    MySQL Hash Join实现分析

    On-disk Hash Join不断迭代左表,每当填充满内存时暂停迭代左表,接下来探测完所有右表数据。清空内存后继续迭代左表,反复上述流程直到处理完所有左表中的数据。 1.2 On-disk Hash Join Basic Hash Join的限制在于内存需要装载整个外表。 On-disk Hash Join为了控制内存占用,将外表分成若干片段执行,使得内存能够容纳单个分片。每当外表填充满hash表时就截断build过程。 MySQL的规避方式是参考On-disk Hash Join的方式分批处理:读满hash表后停止build过程,然后执行一趟probe。 从Build阶段最小化磁盘IO的角度,On-disk Hash Join的章节中可以发现MySQL中也保留了一份内存大小的hash表,避免了这部分数据的IO。

    3K20编辑于 2021-12-30
  • 来自专栏MySQL 8.0

    MySQL 8.0曾经最让人期待的新特性

    On-disk Hash Jion 基础的hash join要求在内存中装载整个驱动表(或者驱动表中满足谓词过滤条件的结果集),所以一般选择参与连接的两张表中记录数较小的表或者经过谓词过滤后结果集较小的表作为驱动表 如果hash表大小超过join_buffer_size,那么hash join就需要调整为On-disk Hash Join。 On-disk Hash Join为了控制内存占用,将外表分成若干片段执行,使得内存能够容纳单个分片。每当外表填充满hash表时就截断build过程。 在MySQL 8.0.22之后又对On-disk Hash Join进行了一些优化,分别对驱动表和被驱动表构建hash表分布在磁盘的分片文件中,然后对相同分片编号(连接键相同)的分片中的数据再进行hash 总体来说,On-disk Hash Join的性能就会差很多了。 4. Hash Join的使用场景 hash join可以用于内连接、外连接、半连接、反连接的等值或非等值连接。

    1.1K31编辑于 2022-05-29
  • 来自专栏NoSQL数据库

    【赵渝强老师】MongoDB的存储引擎

    In-Memory 存储引擎  In-Memory存储引擎将数据存储在内存中,除了少量的元数据和诊断(Diagnostic)日志,In-Memory存储引擎不会维护任何存储在硬盘上的数据(On-Disk

    29010编辑于 2024-08-30
  • 来自专栏数据库新发现

    Oracle数据恢复、数据库恢复、灾难恢复专题

    备份恢复基础知识Cache-low rba 与 on-disk rba - 恢复笔记 Oracle的恢复从上一次成功的写出开始,也就是以Cache-Low RBA为起点,恢复至日志的最后成功记录,也就是以 On-Disk RBA为终点。 备份恢复基础知识 Cache-low rba 与 on-disk rba - 恢复笔记 Oracle的恢复从上一次成功的写出开始,也就是以Cache-Low RBA为起点,恢复至日志的最后成功记录, 也就是以On-Disk RBA为终点。

    5.9K30发布于 2018-09-05
  • 来自专栏golang算法架构leetcode技术php

    golang源码分析:cayley(1)

    : An in-memory store, used mostly to quickly verify KV backend functionality. leveldb: A persistent on-disk store backed by LevelDB. bolt: Stores the graph data on-disk in a Bolt file mongo: Stores the graph

    54321编辑于 2023-09-06
  • TrustGraph:为什么说图数据库是解决 AI 幻觉的关键?

    核心决策:图存储引擎的权衡 (On-Disk vs. In-Memory) 在 TrustGraph 支持的选项中,Neo4j 和 Memgraph 代表了两种不同的设计哲学。 Memgraph 对比表 特性 Neo4j Memgraph 核心架构 基于磁盘 (On-disk) 基于内存 (In-memory) 实现语言 Java C++ 最佳场景 系统记录、通用图存储、不频繁写入的静态大数据

    18910编辑于 2026-03-13
  • 来自专栏python3

    Rsyslog+H3C日志系统

    # Remote Logging (we use TCP for reliable delivery) # # An on-disk queue is created for this action.

    2K20发布于 2020-01-09
  • 来自专栏生信技能树

    scATAC-seq数据分析的Python包——SnapATAC2

    此外,SnapATAC2还支持on-disk data structures 以及 out-of-core algorithms,以便更好地处理大规模数据集而不会过分消耗系统资源。

    87210编辑于 2024-03-25
  • 嵌入式数据库调研

    differing application programming interfaces (SQL as well as proprietary, native APIs); storage modes (on-disk

    1.9K20发布于 2020-12-30
  • 来自专栏全栈程序员必看

    搭建rsyslog日志服务器_syslog服务器

    # Remote Logging (we use TCP for reliable delivery) # # An on-disk queue is created for this action. # Remote Logging (we use TCP for reliable delivery) # # An on-disk queue is created for this action.

    3.2K11编辑于 2022-11-08
  • 来自专栏程序猿的大杂烩

    mongodb创建集合与php扩展

    difference between current eviction generation when the page was last considered" : 0, "Average on-disk when the page was last considered" : 0, "Maximum page size seen" : 0, "Minimum on-disk image size seen" : 0, "Number of pages never visited by eviction server" : 0, "On-disk

    2K20发布于 2020-09-23
  • 来自专栏GreatSQL出品技术文章

    MySQL Hash Join前世今生

    WL#2241: Hash join (变更版本:8.0.18) 主要内容: 新增执行类 HashJoinIterator ,实现 hash join 算法原型 (支持on-disk hash) HASH hash join table实现( from mem_root_unordered_multimap to robin_hood::unordered_flat_map) 优化内存管理和使用,降低了 on-disk

    63330编辑于 2023-02-22
  • 来自专栏沃趣科技

    ASM 翻译系列第三十六弹:ACFS磁盘组的重平衡操作

    # /sbin/mkfs -t acfs /dev/asm/vol1-142 mkfs.acfs: version = 11.2.0.3.0 mkfs.acfs: on-disk version # /sbin/mkfs -t acfs /dev/asm/vol2-142 mkfs.acfs: version = 11.2.0.3.0 mkfs.acfs: on-disk version # /sbin/mkfs -t acfs /dev/asm/vol3-142 mkfs.acfs: version = 11.2.0.3.0 mkfs.acfs: on-disk version

    1.2K110发布于 2018-03-26
  • 来自专栏MySQL修行 | 老叶茶馆

    MySQL Hash Join前世今生

    WL#2241: Hash join (变更版本:8.0.18) 主要内容: 新增执行类 HashJoinIterator ,实现 hash join 算法原型 (支持on-disk hash) HASH hash join table实现( from mem_root_unordered_multimap to robin_hood::unordered_flat_map) 优化内存管理和使用,降低了 on-disk

    56720编辑于 2023-02-18
领券