Skip to content

MaterializeMySQL run error #14894

@little-tomato

Description

@little-tomato

I have created MaterializeMySQL with:
CREATE DATABASE dmp_idm ENGINE = MaterializeMySQL('xxx:3307', 'dmp_idm', 'root', 'xxx');

my.cnf:
gtid_mode=on
enforce_gtid_consistency=true
binlog_format=ROW
log-bin=mysql-bin

see the log:
tail -100f clickhouse-server.err.log
2020.09.17 10:37:30.979768 [ 13674 ] {} BaseDaemon: ########################################
2020.09.17 10:37:30.979849 [ 13674 ] {} BaseDaemon: (version 20.9.1.4571 (official build), no build id) (from thread 13578) (no query) Received signal Segmentation fault (11)
2020.09.17 10:37:30.979889 [ 13674 ] {} BaseDaemon: Address: 0x2d85ef80 Access: write. Address not mapped to object.
2020.09.17 10:37:30.979914 [ 13674 ] {} BaseDaemon: Stack trace: 0x15c225a8 0x15c188f8 0x15c1bf25 0x15889272 0x15bf6aa2 0x15bf8402 0x157e7064 0x157f10d5 0x157f2803 0x1582ccb9 0x1582f0ee 0x157eaa91 0x157ef71b 0x157efc36 0xe641547 0xe63fb83 0x7fd0189fcdc5 0x7fd01831e21d
2020.09.17 10:37:30.980005 [ 13674 ] {} BaseDaemon: 3. std::__1::enable_if<(std::__1::__is_cpp17_forward_iterator<std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >::value) && (std::__1::is_constructible<std::__1::shared_ptrDB::IAST, std::__1::iterator_traitsstd::__1::iterator_traits::reference>::value), std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >::type std::__1::vector<std::__1::shared_ptrDB::IAST, std::__1::allocator<std::__1::shared_ptrDB::IAST > >::insert<std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST> >(std::__1::__wrap_iter<std::__1::shared_ptrDB::IAST const>, std::__1::iterator_traits, std::__1::iterator_traits) @ 0x15c225a8 in /usr/bin/clickhouse
2020.09.17 10:37:30.980034 [ 13674 ] {} BaseDaemon: 4. ? @ 0x15c188f8 in /usr/bin/clickhouse
2020.09.17 10:37:30.980056 [ 13674 ] {} BaseDaemon: 5. DB::MySQLInterpreter::InterpreterCreateImpl::getRewrittenQueries(DB::MySQLParser::ASTCreateQuery const&, DB::Context const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x15c1bf25 in /usr/bin/clickhouse
2020.09.17 10:37:30.980081 [ 13674 ] {} BaseDaemon: 6. DB::InterpreterExternalDDLQuery::execute() @ 0x15889272 in /usr/bin/clickhouse
2020.09.17 10:37:30.980095 [ 13674 ] {} BaseDaemon: 7. ? @ 0x15bf6aa2 in /usr/bin/clickhouse
2020.09.17 10:37:30.980113 [ 13674 ] {} BaseDaemon: 8. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) @ 0x15bf8402 in /usr/bin/clickhouse
2020.09.17 10:37:30.980126 [ 13674 ] {} BaseDaemon: 9. ? @ 0x157e7064 in /usr/bin/clickhouse
2020.09.17 10:37:30.980138 [ 13674 ] {} BaseDaemon: 10. ? @ 0x157f10d5 in /usr/bin/clickhouse
2020.09.17 10:37:30.980149 [ 13674 ] {} BaseDaemon: 11. ? @ 0x157f2803 in /usr/bin/clickhouse
2020.09.17 10:37:30.980174 [ 13674 ] {} BaseDaemon: 12. DB::commitMetadata(std::__1::function<void ()> const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x1582ccb9 in /usr/bin/clickhouse
2020.09.17 10:37:30.980195 [ 13674 ] {} BaseDaemon: 13. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582f0ee in /usr/bin/clickhouse
2020.09.17 10:37:30.980226 [ 13674 ] {} BaseDaemon: 14. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse
2020.09.17 10:37:30.980249 [ 13674 ] {} BaseDaemon: 15. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse
2020.09.17 10:37:30.980261 [ 13674 ] {} BaseDaemon: 16. ? @ 0x157efc36 in /usr/bin/clickhouse
2020.09.17 10:37:30.980279 [ 13674 ] {} BaseDaemon: 17. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse
2020.09.17 10:37:30.980291 [ 13674 ] {} BaseDaemon: 18. ? @ 0xe63fb83 in /usr/bin/clickhouse
2020.09.17 10:37:30.980329 [ 13674 ] {} BaseDaemon: 19. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so
2020.09.17 10:37:30.980349 [ 13674 ] {} BaseDaemon: 20. clone @ 0xf621d in /usr/lib64/libc-2.17.so
2020.09.17 10:38:11.697416 [ 13738 ] {} MaterializeMySQLSyncThread: Code: 76, e.displayText() = DB::ErrnoException: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  1. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  2. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  3. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  4. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  5. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  6. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  7. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  8. ? @ 0x157efc36 in /usr/bin/clickhouse

  9. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  10. ? @ 0xe63fb83 in /usr/bin/clickhouse

  11. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  12. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))
    2020.09.17 10:38:11.698228 [ 13738 ] {} MaterializeMySQLSyncThread: Code: 76, e.displayText() = DB::ErrnoException: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  13. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  14. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  15. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  16. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  17. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  18. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  19. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  20. ? @ 0x157efc36 in /usr/bin/clickhouse

  21. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  22. ? @ 0xe63fb83 in /usr/bin/clickhouse

  23. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  24. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))
    2020.09.17 10:38:26.307285 [ 13793 ] {fc34c804-2465-413b-97f6-cb7aca0526c8} executeQuery: Code: 76, e.displayText() = DB::Exception: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists (version 20.9.1.4571 (official build)) (from 172.30.108.6:51390) (in query: SELECT * FROM dmp_idm.invitation FORMAT TabSeparatedWithNamesAndTypes;), Stack trace (when copying this message, always include the lines below):

  25. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse

  26. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse

  27. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse

  28. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse

  29. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse

  30. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse

  31. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse

  32. ? @ 0x157efc36 in /usr/bin/clickhouse

  33. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse

  34. ? @ 0xe63fb83 in /usr/bin/clickhouse

  35. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so

  36. clone @ 0xf621d in /usr/lib64/libc-2.17.so

2020.09.17 10:38:26.307798 [ 13793 ] {fc34c804-2465-413b-97f6-cb7aca0526c8} DynamicQueryHandler: Code: 76, e.displayText() = DB::Exception: Cannot open file /data/clickhouse/metadata/dmp_idm//.metadata.tmp, errno: 17, strerror: File exists, Stack trace (when copying this message, always include the lines below):

  1. Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x18bcb170 in /usr/bin/clickhouse
  2. DB::ErrnoException::ErrnoException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int, std::__1::optional<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > const&) @ 0xe617f8b in /usr/bin/clickhouse
  3. DB::throwFromErrnoWithPath(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, int) @ 0xe615d8a in /usr/bin/clickhouse
  4. DB::WriteBufferFromFile::WriteBufferFromFile(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned long, int, unsigned int, char*, unsigned long) @ 0xe71f608 in /usr/bin/clickhouse
  5. DB::MaterializeMetadata::transaction(DB::MySQLReplication::Position const&, std::__1::function<void ()> const&) @ 0x1582e78c in /usr/bin/clickhouse
  6. DB::MaterializeMySQLSyncThread::prepareSynchronized(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157eaa91 in /usr/bin/clickhouse
  7. DB::MaterializeMySQLSyncThread::synchronization(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x157ef71b in /usr/bin/clickhouse
  8. ? @ 0x157efc36 in /usr/bin/clickhouse
  9. ThreadPoolImplstd::__1::thread::worker(std::__1::__list_iterator<std::__1::thread, void*>) @ 0xe641547 in /usr/bin/clickhouse
  10. ? @ 0xe63fb83 in /usr/bin/clickhouse
  11. start_thread @ 0x7dc5 in /usr/lib64/libpthread-2.17.so
  12. clone @ 0xf621d in /usr/lib64/libc-2.17.so
    (version 20.9.1.4571 (official build))

help me,please!

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions