Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] 写入失败&超时 #2700

Closed
1 task done
hexuxu110 opened this issue Dec 8, 2024 · 2 comments
Closed
1 task done

[Question] 写入失败&超时 #2700

hexuxu110 opened this issue Dec 8, 2024 · 2 comments
Labels
inactive question Further information is requested

Comments

@hexuxu110
Copy link

Problem Type (问题类型)

performance (性能优化)

Before submit

  • 我已经确认现有的 IssuesFAQ 中没有相同 / 重复问题 (I have confirmed and searched that there are no similar problems in the historical issue and documents)

Environment (环境信息)

  • Server Version: 1.0.0 (Apache Release Version)
  • Backend: RocksDB x nodes, HDD or SSD
  • OS: 128 CPUs,1024 G RAM, CentOS 7.2
  • Data Size: (like 50亿 点, 50亿 边) -->

Your Question (问题描述)

public class EventHub {

private static final Logger LOG = Log.logger(EventHub.class);

public static final String EVENT_WORKER = "event-worker-%d";
public static final String ANY_EVENT = "*";

private static final List<EventListener> EMPTY = ImmutableList.of();

// Event executor
private static ExecutorService executor = null;

private String name;
private Map<String, List<EventListener>> listeners;

public EventHub() {
    this("hub");
}

public EventHub(String name) {
    this(name, 1);
}

往hugegraph里面写数据,写数据会涉及更换图缓存,图数据相关操作,都是用eventhub来处理,但这里老是单线程池,来不及处理,导致大部分写入操作放在了单线程池的阻塞队列,该阻塞队列占用大量内存,导致后面写入操作申请不到内容,从而导致写入失败,我看你们已经把这块修复了,但是1.3.0版本还是单线程池,希望快速发布这个改动

Vertex/Edge example (问题点 / 边数据举例)

public class EventHub {

    private static final Logger LOG = Log.logger(EventHub.class);

    public static final String EVENT_WORKER = "event-worker-%d";
    public static final String ANY_EVENT = "*";

    private static final List<EventListener> EMPTY = ImmutableList.of();

    // Event executor
    private static ExecutorService executor = null;

    private String name;
    private Map<String, List<EventListener>> listeners;

    public EventHub() {
        this("hub");
    }

    public EventHub(String name) {
        this(name, 1);
    }

Schema [VertexLabel, EdgeLabel, IndexLabel] (元数据结构)

@dosubot dosubot bot added the question Further information is requested label Dec 8, 2024
@JackyYangPassion
Copy link
Contributor

JackyYangPassion commented Dec 8, 2024

  1. 线上着急话可以尝试将PR apply patch 的方式引入你当前的版本
  2. release-1.5.0 分支已存在,可自行编译安装, 也可以参考下面的发票投票链接直接下载最新版测试 (有二进制包)
  3. 更新, 1.5.0 已经发布了, 可以随时更新

refer:

Copy link

Due to the lack of activity, the current issue is marked as stale and will be closed after 20 days, any update will remove the stale label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
inactive question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants